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This research studied the processes which enable 
people to acquire semantic information from natural-language 
discourse. Specific objectives were: (1) to represent semantically 
the structural meaning of English discourse by a well-defined 
semantic model; (2) to develop a way of using the semantic 
representation of a text as a structural model for scoring a 
subject's acquired knowledge; (3) to develop a process model for 
discourse comprehension; and (4) to investigate hypotheses about the 
effects of certain contextual conditions, designed to induce 
inferences about text content, on knowledge acquired from a text. 
Written reconstructions of knowledge acquired from a 'text were used 
in three experimenta 1 ^contexts: "arbitrary," "problem solving," and 
an incidental memory condition. Basic data consisted of the relative 
frequencies of classes of response from a semantic analysis of recall 
procedures. Results were consis-tent with a model of comprehension 
consisting primarily of "generative" rather than purely 
"interpretive" processes. Sources of individual differences were also 
studied. Part 2 contains a detailed development of a semantic 
structural model of English discourse and a technique for measuring 
semantic information acquired from discourse. (Author/DI) 
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Abstract 



This research was concerned with the processes which enable individuals 
to acquire semantic information from natural-language discourse.. 
Specific objeci^ives were: (1) to represent semantically the structual 
meaning of English discourse* in terms of a well-defined semantic model, 
(2) to develop a procedure for using. the semantic representation of a 
text as a structural model against which a subject's acquired knowledge 
can be scored, (3) to develop a process model for discourse comprehen- 
sion, and (4) to investigate hypotheses concerning effects of certain 
contextual conditions designed to induce inferential operations on 
text content on knowledge structures acquired from 'a text. The task 
involved obtaining repeated written reconstructions of knowledge 
acquired from a text. Three experimental contexts were used: (1) an . 
"arbitrary" context, (2) a "problem solving" context, and (3^ an 
incidental memory condition (three problem solving trials followed by 
incidental recall). Groups one and two wrote four rt-calls; all 
groups were tested one week later. Basic data consisted of the 
relative frequencies of classes of response obtained from a semantic 
analysis of recall protocols. Results were consistent with a model of 
comprehension consisting primarily of "generative" rather than purely 
"interpretive" processes. Sources of individual differences were also 
studied. Part II contains a detailed development of a semantic 
structural model of English discourse and an associated technique for 
measuring semantic information acquired from discourse. 
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PREFACE 



The research to be described in this paper began as a project concerned 
with investigating cognitive processes involved in '^complex ideational 
learning", i.e. in acquiring new semantic information from natural 
language discourse. One reason for undertaking such a study was the 
lack of research employing natural-language discourse in non-verbatim 
learning tasks and our consequent ignorance about the processes involved 
in such learning. A second was that rote learning tasks thevuselves 
appear to involve organizational procesbas which are rather more specif i 
to a given task than has generally been supposed (Freder iksen, 1969, 
1970) . Thus it was decided to investigate processes governing the 
acquisition of non-verbatim knowledge in different learning contexts 
to attempt to gain some understanding of these processes and the extent 
of their invar iance over different concexts in vjhich this learning 
takes place. In particular, two sorts of contexts were to be considered 
an arbitrary context in which a set of linguistically coded semantic 
elements are to be acquired, remembered!, and reconstructed; and a non- 
arbitrary context in which, in addition \to being remembered and recon- 
structed, these elements are to be the object of some additional 
stipulated cognitive operations such as applying inductive or deductive 
reasoning to solve a problem involving the elementE, or relating a 
set of ideas to other knowledge in a non-rl trary manner. It w^s 
sur posed that processes involvec in acqu ri: knowl^ dge f^:^ i c^r:nected, 
logical arguments might be dependent on .. nature f "j^uperor i -ite'* 
processing operations on the sema ntic co: ^nt: of tl essay. J , the 
experimental strategy adopted in" olved me . ul-atin^ chrc ugh a 
conditions the likelihood and ex: ant to v: .ih i-ndiv .dua . v ' opt 
certain modes of information proc ^ssing w .:h invol e cogni or- 
ations on the semantic content of a connec::ed verba.- argume: 
studying various properties of the temporal course of learning perfor- 
mance for different task-groups so defined. 

Naturally, the first problem e. .countered in this work (and the key 
problem confronting anyone attempting to study in a direct manner 
the acquisition of nonverbatim Tcnowledge from discourse) was that of 
obtaining a sufficiently objective and complete specification of the 
semantic properties of the stimulus passage and obtaining a set of 
measurements which are sufficient to provide an objective and suffi- 
ciently complete description of the properties of the verbal protocols 
which constitute "learning performance/* A starting point for the 
development of a solution to this problem of formally specifying the 
semantic properties of a stimulus passage consisting of a connected 
logical discourse was suggested by Dawes* (1966) experiments on the 
distortion of meaningful written materials in remembering, and Frase's 
(1969) demonstrations of the effects of thinking about partirnlar 
semantic relations present in a text (represented structurally iu 
the form of directed graphs) on recall of elements taken from cha text. 




V 



Dawes developed passages around a number of set relations and attempted 
to measure by reference to the set relations specified in the passage 
processes of distortion of relationships and selection in memory. 
Frase's work Incorporated the idea that textual materials may be 
represented in terms of networks of set relations symbolized as 
directed graphs (cf., Harary, Norman, and Cartwright, 1965). 

Having decided to try to represent the semantic features of a connected 
discourse as a network of set relations, it was decided that a set of 
conventions would have to be developed for the specification of a 
semantic model for any connected passage. The model was to be repre- 
sente.i diagraraiuatically or, more rigorously, as graph-structures of 
two sorts: (1) a semantic structure graph representing relations 
among concepts and (2) a logical structure graph representing impli- 
cations among propositions. Incidentally, it was initially felt that 
it is not neciessary that such a model be unique, only that it be- well 
defined and capable of generating the passage. The problem of scoring 
semantic or "ideational'* features of a subject's written reconstruc- 
tion of the input could th n be treated by reference tc the model of 
the input by a templating- . • tching process, provided tYic't a sarisfactor 
model is available. At th. . pcint another difficulty ? encouatered. 
Given a structural model of :he input and a subject's vr tten r^con-- 
struction of the input (pr esuraaoly also represer. table sti jctura. ly 
using the same conventions us^A to develop a stri'tural model ot the 
in^iriut) , how might the degree of correspondence o:' these two structures 
be measured? For example, if a particuT.ar relatic :a ARB is prese^it in 
the input (where R is a directed relati-jri froni cirncept A to cone pt B) 
an:- a relation A^R 3' is present a LUijject 's Trritten pr^.tocol how 
'-';l:-t A'R'" b:- iacT-tilf ied with rela~:-on AF3 cccained in the odel 

I :he inp: :, and g-.'/en sunh idenuif ication, nov ^r^ight the subject's 
relation differ from the relation of the model with which it is 
identified? In the presence of these complexities, it appeared that 
the development of a solution to the scoring problem just described 
would require the statement of some sort of outline of a theory of 
comprehension as well as of memory processes. Since the verbal protocol 
produced by a subject as a reconstruction of a connected logical 
argument which he has just read or heard is the. result of a sequence 
of comprehension-memory-reconstruction processes, relations between 
ARB and A'R'B' ought to be describable in terms of classes of responses 
resulting -from the application of these processes.. 

The research activities described in this report reflect these devel*- 
opments in our conceptualization of the problem and hence the scope 
of the activities reported^ here goes considerably beyond that of the 
originally proposed study.' As a result, the work has become more 
heavily oriented towards psycholinguistic questions and information 
processing models* Our initial activities described in Part I involved 
developing the outlines of a model for semantically representing 
English tex*- , a procedure for measuring semantic knowledge acquired 
from texts,, and the outlines of a process model. Our later activities 
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described in Part II have been concerned predominantly with the . 
problem of developing a formal semantic model for representing 
any natural language discourse up to a paraphrase transformation, 
and with developing a satisfactory procedure for representing the 
semantic information which results when subjects reconstruct the 
knowledge which they have acquired from a presented discou' ^e. 
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CHAPTER 1 
GENERAL INTRODUCTION 

1.1 Problem and Objectives 

Stated in gene^ral terms, the long-term objectives of the research 
reported here are to identify and measure processes by which 
individuals are able to acquire semantic knowledge from English 
■discourse, to determine the extent of 5.nvariance of these processes, 
and to identify sources of individual differences in these processes, 
A more specific statement of these objectives requires both a satis- 
factory definition of what "semantic knowledge" consists of and how 
it may be represented and measured, and a satisfactory definition 
of processes which may be involved in acquiring semantic knowledge 
from a discourse. While there are considerable bodies of research, 
both linguistic and psychological, which are pertinent to these 
problems, there:.is virtually nothing existing in the literature which 
provides either a ready-made procedure for representing English 
texts semantically or a satisfactory account of possible alternative 
processes or process models for the comprehension and memory of 
information presented in texts. Thus, a very considerable amount 
of effort in this project has been devoted to these problems. 
Once a well-defined procedure is available for representing* an 
English text semantically, the resulting semantic representation of 
a text (semantic model) can be used as a reference structure (or 
'template") against which a subject's acquired semantic knowledge may 
be measured. Then, given the semantic model and the measurement 
procedure, it becomes possible to' investigate particular processes 
involved in acquiring knowledge from a presented discourse by identi- 
fying properties of discourses and discourse contexts which effect • 
outputs associated with particular processing operations in comprehen- 
sion and semantic memory. 

The basic data resulting from the above semantic analysis consist of 
the relative frequencies of particular classes of semantic structural 
element;s^^vhich have been defined in the semantic model and which are 
observed in subjects' verbal reconstructions of the knowledge they 
have acquired from a text. Obsen^ed semantic elements in a subject's 
verbal protocol may be reproduced (i.e. they may correspond to elements 
of the semantic model), or they may be transformed or generated by the 
subject himself. Individual and group differences may be described in 
terms of the relative frequency of occurrence of particular classes of 
semantic elements and in terms of the extent of employment and effi- 
ciency of particular processes in comprehension and semantic memory. 
The emphasis in the present research is on the comprehension (acquisi-^ 
tion) of semantic knowledge on cognitive operations on knowledge 
structures only insofar as .they relate to processes of acquisition. 
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Specific objectives include: (1) the development of a formal method 
for semantically representing the structural meaning of English 
discourse, (2) the developinent of a method tor measuring correspon- 
dences between the "meanings" of a discourse and the "meanings" 
conveyed by a subject in reconstructing the knowledge he has acquired 
from a presented discourse given a well-defined logico-semantlc 
representation of the input passage but only the surface str- 
a subject's reconstruction, and (3) the investigation of pio. 
invariance re. possible effects of context-induced cognitive operations 
on semantic infomation acquired from a discourse on the processes 
used to acquire that information. 

The first sections of this chapter briefly review research pertinent 
•to the following four problems: (1) representing semantically the 
information content , of English prose passages in terms of a well- * 
defined semantic and logical structural model, (2) developing '^a proce- 
dure for using the semantic representation of a text as a structural 
model against which a subject's acquired knowledge may be analysed 
and scored, (3) developing a reasonably well-^def inesd process model for 
language comprehension and semantic memory, and (4) investigating 
hypotheses concerning the effects- of surface and semantic properties 
of discourses and discourse -contexts on knowledge structures acquired 
in comprehending and remembering semantic information presented in 
linguistically encoded form*' Procedures, for representing the semantic ' 
structure of a text. and for measuring semantic knowledge acquired 
from a text which have been developed in the present research are 
described briefly to indicate their relationship/to prior techniques.. 
Research concerned principally with effects of discourse contexts will, 
be reviewed in chapter 2. 

1.2' Semantic Representation of Discourse 

■■^ ' • ' ' ■ ' ■ ' ' • 

An essential precondition for successful research in the area of 
language .comprehension and semantic information processing is to have 
at hand a technique for specifying in an objective, well-defined manner, 
the semantic properties of any stimulus passage. Thus, one is con- 
fronted^^t the outset with the difficult problem of developing a 
semantic description of English texts which is capable of representing 
discourses consisting of many sentences, given only the surface struc- 
ture of the text. A general requirement- of such a semantic descrip^ 
tion of a text is that it should not represent , the surface grammatical 
structure of the text (except insofar as the surface structure 
uniquely i.epresents a given meaning) ; rather, a semantic description 
should be capable of representing each sentence only up to a paraphrase 
transformation. Thus, from a given semantic structure one should in 
general be able to generate a set of grammatically well-formed sentences, 
each of which expresses the meaning specified by the semantic structure. 
This requirement stems from the premise that a minimal demonstration 
of ^comprehension of a text consists of the ability to paraphrase the 
text. 
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A semantic represfentation of natural language sentences has been 
considered by many linguists to consist of a set of lexical elements 
(represented semantically as, e.g., a set of binary features) which 
are interrelated in networks of structural relations, both in the 
surface sentences (surface graimnaticr ' ^^tt' the undci.- 

lying propositions from which the su.race sentences Und their para- 
• hrases) are derived ("deep'' semantic structure). Linguistic theories 
differ in the extent to which they are willing to define "deep struc- 
ture" relations which are diitlnct ^'f :om syntactic relations (which . 
are defined in the su'-face s'::ructure or "syntactic deep structure"). 
Recent work in "gener. . -ve s-niantics" (e.g. Maclay, 1972; Lakoff, 
1972) and the case gramiuar 1 :"eas of Fillmore (1968, 1971) provide 
the starting point f c ' a structural semantic description of discourse 
which is not defined ^olely in terms of . grammatical relations appear- 
ing in the surface sentences. These approaches to semantic descrip- 
ticn recall the stratlf ^caticnal approach of structural linguistics 
whxch supposes that S( itences can be described in terms of a number 
of self-contained descriptive levels (e.g. phonological, syntactic, 
semantic) with rules of expression which map from "deeper", levels 
to more surface lev^ Is (e.g. from semantic aeep structure to surface 
sentences, or from surface sentences to sound patterns) (cf. Leech, 
196"), From this point of view, a syntactic description should not 
be developed in isolation, but should provice an optimal input to 
the -emantic system (ci Halllday, 1967, 1970). The present discus- 
sioi, will be concerned eMclusi^/ely with the problem of .developing a 
self-contained semantic representation of English discourse. To make 
this restricted problem more manageable, it seems possible to adopt 
the limited objective of representing only the structural as opposed 
to lexical meaning of a rext. Thus, rather than attempt to represent 
concepts corresponding to lexical elements structurally, concepts . 
will "be taken as "primitives" in the semantic analysis and will be 
represented by lexical desigr-tors which are referred (at present) to 
standard dictionary citations. This limited objective has been . 
adopted here to avoid the problem of determining how much lexical 
analysis to include (i.e. hov much to "deconflate" lexical elements), 
and to expedite scoring subjects' reconstructions of the meaning of 
a text. It is not yet clear vnether or not individual lexical 
elements should be considered to be "primary" functional units in 
semantic long-term memory. 

Two procedures for representing a discourse semantically were developed 
in the present research and are described in detail in chapters 3 
and 9. The first procedure which was developed was intended to repre- 
sent str-c-cturally the "essential" logical features of a passage in 
a manner similar to precis-writing so that -he tesulting senantic 
structure (a network or graph consisting of noces and connecting 
relations) could be used as a model or templa .e against which one , 
could score subjects' rritten reconstructions of the knowledge they . 
he- 1 acquired from the passage This procedur provides a relatively 
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global summary of certain loj^ical and semantic properties of a 
passage. In order to h..;e lore detailed and llnguisticalLy-based 
semantic structural model r . linglish discourse which is capable of 
representing more complex texts and semantic relations, and yet one 
which continues to represent the inter-clausal "logical" structure 
as well as the intra-clausal "semantic" structure, a second proce- 
dure was developed . for representing the logico-semantic structure 
of discourse. The second procedure was influenced substantially 
by recent work in linguistic semantics (Fillm9re, 1968, 1971), 
computational linguistics (Simmons, 1^8, 1970, 1971, 1972), arti- 
ficial intelligence (Quillian, 1968; Riphael, 1968; Winograd, 1972; 
Schank, 1971) , and psycholinguistic work involving discourse (Crothers, 
1970, 1971)* Well-known concepts frojsr logic and algebra were employed 
as well as Rescher's (1964) analysis of contraf actual conditional 
statements and Simon and Rescher's[ (1966) analysis of causal contra- 
factuals. Other relevant work includes the work of Lakoff (1972) and 
Chafe (1970) in linguistic seman^cs, the work of Kintsch (1972) and 
Rununelhart, Lindsey and Norman (1972) in semantic memory, and recent 
work in developmental psycholinguistics concerned- with semantic 
description of pre-school, children's speech (Antinucci, 1970, 1971; 
Wells, 1972; Wells, Antiniiuci, and Slobin, 1972). 

The second procedure (described- in detail in Chapter 9) differs from 
the earlier one in a number of important respects. First, it repre- 
sents a text as two separate graphs consisting of nodes connected by 
directed lines representing binary relations (cf. Harary, Norman, 
and Cartwright, 1965): a semantic structure graph representing binary 
semantic relations defined on concept-pairs such as relations of 
attribution, possession, quantification, and case relations involving 
active or stative verbs (cf. Fillmore, 1971); and a logical structure 
graph representing various logical (intersential) connectives defined 
on propositions which are represented in the semantic structure graph. 
This representation of a text as -two separate graphs appears to be 
desirable for a number of reasons (which are indicated in Chapter 9) . ' 
Second, the concepts (which are the "givens" or "primitives'* in the / 
analysis) correspond to single lexical items. No attempt is made in 
the present analysis to represent the lexical primitives semantically 
nor is any position taken on the nature of such representations . 
Rather, the purpose is to attempt to represent those semantic struc- 
tural relations which a given discourse imposes (explicitly or 
implicitly) on its lexical elements. Third, since the two graph 
structures are in themselves insufficient to represent a text struc- 
turally, seven basic operators on relations in the semantic or logical 
structure graphs are defined which qualify* or constrain the truth 
value of the relation to which they are applied • These operators 
include a truth-value operator (negation), probability operator (e.g. 
qualifying modal auxiliaries), temporal operator (tense), aspect 
operator, node deletion operator (e.g. deletion of a concept having 
an implied case-relation to a verb), conditional operator (which 
renders a relation conditional on other semantic relations) and 
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interrogative operator (which interrogates the probability attached 
to a relation). Both logico-semaritic fitructural models are capable ^ 
of representing structural properties of discourses consisting of many P/ 
sentences. From the point of view of semantic analysis, sentence or 
clausal boundaries are regarded ,as surface phenomena having no intrinsic 
semantic interest. The result of these changes is a structural repre- 
sentation of prose which resembles in certain respects that of Simmons 
(1968, 1971, 1972) and utilizes principles of semantic analysis similar 
to those recently discussed by , linguists (cf. Fillmore, 1968, 19^; 
Leech, 1970), psycholinguists (cf. Clark, 1972), and researchers ihter- 
ested in computer models of language processors (e.g. , Quillian, 1968; 
Raphael, 1968; Schank, 1971; Winograd, 1972). ' 

Despite the limited number of defined semantic and logical relations,, 
this structural model appears to be capable of representing some rather 
complicated semantic relations (e.g, relative degree, time, location; 
modal expressions such as '*may'\ 'Wst", etc.). Its ability to repre- 
sent relatively complicated texts is also demonstrated by the analysis 
of the essay on school desegregation presented -in Chapter 9. Note that 
while it is convenient (for scoring purposes) to represent a text in 
the form of a directed graph, a graph structure may be alternatively 
represented as a list structure (using a progrannning language such as 
LISP or. SNOBAL) » In the. future we plan to use such list representations. 
The idea would be to store a semantic structure corresponding to a 
stimulus text in the fojm of a* list-structure, in[^ut to the computer 
a semantic structure corresponding to a subject's verbal protocol^^ and 
program the computer to evaluate the '-match" between the two structures. 
List structure representations have been employed ir: most work in 
computational linguistics (Simmons, 1971) and semantic information 
processing programs (Quillian, 1968; Raphael,' 1968;- Winograd, 1972), 

1.3 Measurement of Comprehension 

Once a method is available for representing a text. in terms, of a well- 
defined logico-semantic model, in principle the same method that is 
used to analyze a text which is input to a subject- cian also be used to 
analyze a subject's verbal reconstruction of the knowledge he has acquired 
from the input text. In practice, the task of semantically analyzing 

discourse is sufficiently complex that it is extremely unlikely that 
if such a procedure were employed without modification to measure compre-- 
hension, it could be made sufficiently reliable (replicable) , especially 
if\the semantic analysis of a subject's protocol is to be made in a 
reasonably short time. If the 'Waning reconstruction" task is used 
to assess comprehension, the problem of measuring comprehension amounts 
to that of measuring or evaluating the extent to which the "meaning" 
of the input text has been preserved or altered in the subject's verbal 
reconstruction, 'i.e. given the semantic model of the 'input, the problem 
is to obtain objective and replicable measurements of the correspondences 
between structural elements present in the model of the input and semantic 
structural elements present in the subjec^t's protocol in linguistically 
encoded from. The scoring methods which have been developed in this 
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research attempt to make the structural analysis of subject-r/ pratocols 
objective by using the input structure as a model or ''template'' against 
which a subject protocol is fit. These scoring methods are described 
in Chapters 3 and 10. 

Before presenting a brief overview of 'the method which was developed 
for measuring logico-semantic knowledge acquired by a subject in 
comprehending a discourse, other methods which have been employed to 
''measure comprehension" ought to be considered and compared to "meaning 
reconstruction" (free recall) as to potential value to. research on 
comprehension. The most important criteria in evaluating a method ^s 
usefulness for theory (process) -oriented research are (in addition to 
criteria such as reliability and feasibility): (1) the method should 
provide a relatively complete semantic representation of knowledge 
acquired from a presented discourse; (2) the task should not alter the\ 
discourse or the conditioijs under which the discourse is received in 
such a way as to make the task unrepresentative of natural conditions 
of exposure to discourse, (3) the task should permit wide latitude for 
systematic manipulation of surface and semantic properties of discourses 
and of discourse contexts, and (4) the task should provide maximum 
information relevant to identifying and measuring processes in compre- 
hension and semantic memory. 

Carroll (1971a, b) has 'reviewed methods which have been employed to 
measure comprehension and has classified the methods in terms of particu- 
lar measurements obtained, temporal conditions of testing, and task 
characteristics. Of the particular -measurements obtained, the most 
promising^ appear to be (1) measurements involving the observation of 
a particular response and the evaluation of the response against some 
criterion, and (2) time measurements such as measurements of • latencies 
of particular responses or processing times. Latency measurements have 
been used increasingly in psycholinguistic work concerned with processes 
in comprehension (e.g. Clark, 1969, 1970; Trabasso, 1971; Olson, 1971'; 
Kintsch, 1972a, b.) , the method involving predicting the processing time 
for different tasks based on assumed additivity of processing times ' 
associated with particular stages of information processing. A similar 
rationale seems reasonable for data consisting of relative frequencies 
of particular classes of response in free recall tasks (frequencies 
relative to the absolute frequencies of occurrence of the corresponding 
semantic elements in the input text) : a type of response which requires 
more extensive processing (or which requires certain kinds of processing) 
might occur with smaller relative frequency than one which requires 
less extensive processing (or does not require those kinds of processing) 
Since specific processing operations required in comprehending and 
remembering a semantic element from an input text ought to be influenced 
by such factors as the surface, syntactic, • and semantic structural 
properties Df the discourse in. which the element is embedded, and -the 
'size" and complexity of the element processed, the relative frequencies 
of occurrence of corresponding reproduced or transformed elements in 
subjects' free recalls corresponding to these processes ought to be 
systematically affected by these factors. This rationale. has been 



applied in the present research. On the basis of the four criteria 
lifted above, the relative frequency measurements apper.r to be prefer- 
able to latency measurements as measures of comprehension. In addition, 
relative frequency measures (or observations of the occurrence or non- 
occurrence of specific elements in free recalls) have better statis- 
tical and psychometric properties than latency measures. ^For example, 
in addition to mean relative frequencies of occurrence, ohe can investi- 
gate the degree of statistical dependence of frequency measures, and 
the degree of statistical dependence of frequency measures on measured 
subject characteristics, sources of data which can be extremely infor-' 
mative about cognitive processes in comprehension. Techniques for. 
fitting mathematical models to such data to test hypotheses concerning 
processes in comprehension will be discussed in Chapter 6; correlations 
of frequency measures with measures o£ subjects' cognitive abilities 
will be discussed in Chapter 7. \ 

\ 

The temporal conditions of testing identified by ^^arroll (1971) are 
(1) responses are elicited or observed during the\temporal interval 
within which a discour.se is presented, and (2) res'ponses are elicited 
or observed following the presentation of the discdurse. On the basis 
of criterion (2), it appears preferable to obtain measurements after 
the presentation 'has teen completed. The principal treason for making 
observations during the presentation have been to atj^empt to measure 
"pure" comprehension unaffected by memory processes a'^d other processing 
of information which has been acquired during, the pres^entatioh interval 
(such as inference) . As will be argued in the next se^:tion, it is 
inadvisable to* assum'e in advance that memory and inferititial processes 
are separable from "comprehension" • processes and then atjopt a method 
of observation which renders adequate investigation of t4ie role of 
memory and inferential processes ii> comprehension impossible. 

Tasks used to measure comprehension may be classified int(^ (A) those 
which do not alter the "base" comprehension task (uninterrupted presen- 
tation of a discourse), and (B) those which do alter this 6?sk. Tasks 
which do not alter the base comprehension task may be further classified 
into: (1) verification tasks in which verification can be b^sed either 
on (a) identity of information acquired from a text with -information 
contained in another verbal message, in non-verbal referents ^e.g. 
pictures), or against a subject's prior semantic knowledge; oi^^ on 
(b) analysis of infopnation acquired from a text to produce a match 
to some referent; (2) reconstruction tasks (free .recall) : including 
tasks involving nonverbal reconstruction (e.g. motor, symbolic) \and 
those involving verbal reconstruction; and (3) probe retrieval ti ^sks : 
including reconstruction of a part of a test associated with a gl^en 
cue, question answering (involving reconstruction or analytic opei^ations 
on semantic information contained in a previously presented text) ,\ and 
recognition. The verbal reconstruction task may be verbatim, it m£^y. 
involve paraphrase ("free recall"), and it may involve translation \(into 
another language or symbolism). Tasks which alter the base comprehe^n- 
sion task may involve unstructured deletions from 'the text (e.g. Clos^e 
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procedure) or structured deletions (e,g, sentence completion) where 
deletions may be based on surface or syxitactic "properties , or on 
semantic properties. 

In selecting a task to '^measure comprehension" from among the tasks 
just classified, it Is important to realize that the tasks identified 
above are not as distinct as they may at first appear. In fact a 
number of these tasks can be considered to be special cases of a .base 
comprehension task which requires a subject to reconstruct that know- 
ledge which he has acquired from one or more presented texts (where a 
text may contain structured deletions). It is also importarj^t to realize 
that, from a semantic point of view, every discourse is to some degree 
semantically incomplete (i.e. contains semantic deletions) in the sense 
that the semantic structure is incompletely encoded in the surface 
sentences which make up the text. Examples, illustrating this latter 
point are provided by linguistic work concerned with focus and pre- 
supposition (e.g. Fillmore and Langendon, 1971; Chafe, 1970; Lakoff, 
1972) and by semantic, analyses of discourse such as that presented 
in Chapter 9. Our observation in this research that after. one exposure 
to a discourse, subjects' reconstructions of knowledge' acquired from 
the discourse often contain about as many inf erentially generated 
semantic relations as reproduced relations (i.e. relations paraphrased 
from the input text) provides some empirical support for the notion . 
that inexplicit (but inferable) semantic structures are salient 
properties of a text. 

The four criteria listed above argue for adopting the most general 
task • — the base comprehension task — and developing a scoring proce- 
dure for that task which is capable .of representing a subject's verbal 
reconstruction semantically against a semantic model of the' input text. 
Once such a procedure has been developed for the base comiprehension 
task, it may be applied to variations of that task such as probe retrieval, 
verification, and structured deletions. Since structured deletions, 
especially semantic deletions, are only one type of semantic structural 
property, the structured deletion task represents one kind of semantic 
structural property whose effect on processes in comprehension and seman- 
tic memory can be studied. * Probe retrieval and verification taisks in which 
sutrjects are presented with stimulus information after presentation of a 
text, require .comprehension of the probe or to-be-verified message. These 
stimuli may be represented semantically whether or not they. are lin- 
guistic, and the semantic structure associated with a pr^^be question, 
cue, or to-be-verlf ied message may be represented as a part of the 
semantic model of the input text. Thus, for example, a question may 
be represented semantically as an appropriate interrogation of an element 
of the input (see Chapter 9) or, if the question involves inference 
from the input, the required^ inferences can be represented^ Semantically 
and interrogated. Thus verification and probe retrieval tasks involve 
the presentation of multiple texts which may be represented in terms 
of a single semantic structural model. The presentation^ of multiple 
texts is an important experimental technique (and will be used in the 
first experiment proposed below). Finally, as has been recbgnizeci in 
list learning research (Anderson and Bower, 1972), the recognition 
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task is complex, involving (especially if the recognition text i*=^ 
a paraphrase of a part of the input text) comprehension )f both the 
input and '^probe" text and match of semantic elements generated in 
response to the '^probe" stimulus to corresponding semantic elements 
remembered from the comprehension of the input. 

It remains to outline the sco-^'nc; p: thods which have been developed 
for the base comprehension t^ ■ . .e procedures which will be 
discussed In detail in Chapt ind 10 provide a means for generating 
a serujntic model which repre. the "structural meaning" of an input 

passage which is represented (for scoring purposes) in the form of 
two directed graphs: one representiag the semantic structure and one 
representing the logical structure (see the example which is analyzed 
in Chapter 9). The scoring problem is, given this model, to measure 
correspondences between the "meanings" represented by these graph- 
structures and the "meanings" conveyed by a subject's verbal reconstruc- 
tion of the input. The scoring method which was developed Involves 
two procedures: (\) a procedure for scoring reproduced or transformed 
semantic ele^ments by "template-matching" to the structural model of 
the input, and s^2) a procedure- for scoring subject-generated structural 
elements which do not represent reproduced or transformed input elements; 
Procedures will now be outlined which were developed, based on the 
semantic model of Chapter 9, to represent both reproduced and self- 
generated semantic infomation. 

The reproduced structure is scored on a copy of the graph representa- 
tion of the text itself. On these sheets each reproduced concept, 
relation, or proposition is marked with a number indicating the serial 
position of the sentence in the protocol. Any relation which has 
been transformed by a subject by application of one or more of the 
seven operators is marked as so transformed. Scoring the reproduced 
structure involves principally a process of - paraphrasing a protocol 
to fit it. to the structural model of the input text. With some exper- 
ience, it becomes possible to fit directly (without the paraphrase 
step) . The semantic analysis resulting from these operations results 
in a rather large set of possible mearmres. Scores may be obtained 
indicating the extent to which each defined" type of semantic or logical 
relation has been reproduced or'transf ormed , and how it. was transformed. 
Also obtained for the semantic structure is a-measure of the size of 
each complete sub-structure (in number of connected nod_es) and the 
location, of each sub-structure in the semantic hierarchy (level of 
left-most node). Since in the' logical , Structure , a prepositional node 
can be reproduced, can contain transformed, relations, can contain 
deletions, or can contain self-generated elements (elaborations), 
counts of .reproduced or transformed logical relations. must be classi- 
fied according to the status of each prepositional node. The resulting 
measures summarize the extent, to which a person lias, altered the logical 
structure in his reproduction. 
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The analysis of subject-generated structure (i.e. that which is not 
reproduced or transformed) proceeds in a manner similar to the analysis 
of an input text. The principal differences have to do with (1) 
procedures for mapping subject-generated semantic and logical relations 
into the semantic model of the input text and (2) a list representa- 
tion of the coded subject-generated structure. -From the list repre- 
sentation, it should be possible to reconstruct a subject's protocol 
in paraphrase. 

1.4 Processes in Language Comprehension and Semantic Memory 

The methods for representing natural-language discourse semantically 
and for measuring logico-semantic knowledge acquired from a discourse 
which have been developed make it possible to represent precisely 
semantic information input to a subject and to identify the manner in 
which this semantic information has been operated on or transformed 
resulting in the protocol which constitutes the subject's output. By 
systematically manipulating properties (both surface and semantic) 
of discourses input to a subject and , properties of discourse contexts, 
and by measuring the effects of these properties on semantic outputs, 
it should be possible to identify processes involved in comprehending 
and remembering information coded as natural-language discourse. The 
objective of experiments of this type is to determine the scries of 
cognitive operations which occur during and subsequent to the presen- 
tation of a textual input and which result in the protocol obtained 
from a subject, and to determine how these operations are affected by 
properties of discourses and discourse contexts. Before considering 
particular models which have been suggested to account for the proces- 
sing pperations which take place in-between the presentation of a 
linguistic input ;to the subject and his generation of a linguistic 
output, some general statements can be made of requirements which any 
reasonably complete account of these processes ought to satisy. These 
i^eneral requirements become apparent when one considers- the base com- 
prehension task from the point of view of the measurement procedures 
just described. 

A description of the processes which enable a person to perform in the 
base comprehension (meaning reconstruction), task ought to include three 
main components. First, it ought to include a structural description 
of the discourse input tc a subject including in that description both 
surface and semantic properties of the discourse. Second, it ought 
to include a structural representation of the semantic information in 
long-term memory (LTM) which results from the subject's processing of 
the input discourse. Third, it ought to contain a process model con- 
sisting of (1) an account of the processing operations which. occur 
during input in generating the semantic information which is stored 
in LTM, (2) an account of any operations on information stored in 
LTM, and (3) a description of operations which occur during output, 
i.e. in verbally reconstructing information acquired from the input 
discourse. Note that while it is true that a processor can be* described 



in terms of the states of information , after eac 
input information, a more adequate description 
account of the processes which result in these, 
information. The problem, then, is both to desc 
(e.g. what are the units or elements of semanti 
the object of operations in comprehension and n 
processing takes place. One of the most diffic 
research problems encountered in trying to dev€ 
for the base comprehension task involves inferr 
occur at input (input processes) from response 
both input and output processes. As will be S€ 
to make such inferences by fitting certain stoc 
which reflect alternative assumptions about pre 
data (cf. Chapter 6). 

Suppose that a text is presented to a subject a 
represen table in terms of a semantic structure 
zation of structural elements. Suppose also> tli 
to OTite down his reconstruction of the semanti 
— the knowledge which he has acquired and reta 
the passage. Suppose in addition that the pass 
long that any complete reconstruction of the sv 
passage is rendered extremely difficult. A pre 
from a subject is likley to have a number of cli 
example, a protocol will generally not correspc 
tures to the input text; it will contain only s 
elements of the input; these reproduced semanti 
guistically represented ia paraphrase; reproduc 
the subject's protocol will generally not repre 
of the input elements; generated semantic eleme 
subjects' protocols which were never presented 
text in linguistically coded form; many generat 
sent propositions which are inferred from those 
text; and many elements will be transformations 
those contained in the text. Any attempt to mo 
in comprehension and semantic memory will have 
presence of elements such as these in subjects' 
effects of conditions "external" to the passage 
effects, effects of repeated exposure, and forg 
such as these require (1) that the processor be 
capable of generating new semantic informacion 
incomplete" inputs) as well as "interpretive" ( 
tically interpreting linguistically coded input 
the process model account for selection of info 
input or during output, (3) that it account for 
generated semantic information against the inpu 
account for information storage and retrieval p 
and long term and both at input and at output, 
ought to be generally consistent with the stage 
have been found to be involved in other kinds o 



tZ-a^e: of p> r O d S S iXT.^ 

s s & St t s <i> 

— x>srln.^L t zi- s T^^^ <^ *^ ^ ^ ^ 

cry) .aTTLci tn.o^w' t h. 

C^-T^<^ most ri_x^ t or e s t zL r-x:^ ) 
3. X^^'^*^^^'^^ m.<z:> ci IL 
I> rooesses ^wVi zl_ c tL 
sxjLores "wl-LiLol-aL :t II_ ^ o t: 

t e::rr » zi_ t i s ^ o s s zi_t> i g 
tz dLc::i - o^^^v^ tti xnode^J-S 

ses t: li^-irrx^xjL -tr to tln^e: 



tzlriat ttxe t t is 

3 zi^s t il-:irrs of ^.tti- <z> ocr ^ xtil li, — 
tzl::i<& * STj.l=>^ e <z:i t zi, s .^-slcz^ci 
3XT.t^xTLt £ tl-te x:>s.sss^Se 

i zi_xn. <^ oxn^>:rr e^ln^x:i.ci zLn.^ 

zL s sxjL f f zLc: dL^t^n. t 

f e^atxir&s of tVL^- 
:>□_ "wlriLiiL^zi 1:^ is ol=> t ,a zi_art&ci 

t ^ r i s t zi_c^ s - Fo:xr 
Ln. zL t s s x_x:ir f & f — 

O JF tlrte. S eXTX^^^XX t ZLO 

LerrxeLX^ts Tz> ^ IL=i_in. — 

^JL^me^xxts i:> :iz" s XTL t zi_xx 

xrsi^xxcioTn s IL ^o t zi^oxx 
"v^dLn-Il- t> ^ Xz»:iz' ^ s ^xx t zi_xx 
LzLodLtlLy ixx tl^e zi_-r-xp>u_t 
^ IL eiTTi e XX t s i IL XT xr e. — 

XtS^ILXX^ci ZLXX tlrk^L ZLXXX>^-X t 

» o XT ci zi- s to XT t ioxms of , 
cz> ^5 XX ZL t ii_"V7" & X> xr o c:^ s s s 
xc: czr. o xxxzx t f o xr . ttre: 
> t cz> c o s ^ s^xxd f oxr s^xx^r 
»eiILf sxjlcIt. ^a.^ c:. oxrx t e::>c: t ^-XhS. ZL 
Lxn^ • Ot» s exr^v^s. t ioxrt s 

-xx^xra t itve" Ci-e. 
X " s exixaxx t dLonai ILy" 

.a ^ s.lz> IL Gi o f s ^^xn j=a xx — 
f oxrxTxa t zLoxx> - C 2. ;> tlrxat 

-zLoxx e^dLtlrx^xr cixj^xr zLxx^ 
i "^-r exr zL f zL <irs- 1 iLo XX of 
*-xxci C^> tln.s.t zLt 
i s s e s » o t "tx s tx o xr t 

xs-J!LIL3r 9 xrx<z>c5l .s.Il,so 

: ~^~<z><z!: es s zLxx^ tlxsLt 
"^ERIC^ =l^=^ oxrma t dLc 



12 



processing (e,g, pattern recognition, list learning), A more detailed 
description of the structural and process components of a general 
process model for comprehension and semantic memory will now be given 
in reviewing specific processing models. These components are listed 
in Table 1 •I. A process model which incorporates these components v;ill 
be presented in Chapter 4, 

Specific characteristics of existing rocess models for comprehension 
and semantic memory tend to reflect . .e requirements of tl particular 
task for which the process model was developed. Table 1.2 c atains a 
list of tasks and references to papers presenting models fcr each task. 
Existing models may be instructively, compared in terms of the components 
of a .general process model. For example, a structural description 
of the linguistic input is in most cases restricted to representing 
single sentences (e.g. Clark, in press; Trabasso, 1971 ; Olson, 1971; 
Bever, 1970). Winograd's (1972) model does, however, consider 'local 
discourse context^', and Ruramelhart, Lindsay, -and Norman (1971) and 
Crothers (1970, 1971) and Frederiksen (1972 and the present report) 
have considered discourses of unlimited length. The last two investi- 
gators have concerned themselves principally with a semantic description 
of input discourse. 

1. Structural model of semantic information stored in LTM , A structural 
description of the semantic information resulting when the processing 
of the input linguistic string is complete is a part of most models. In 
most instances the hypothesized structure corresponds to a semantic 
description of English. In work on list learning (Kintsch, 1972; 
Runjnelhart, Lindsay, and Norman, 1971) the semantic model is used 
either to specify what information is transferred from a temporary 
memory buffer to LTM or as a basis for particular retrieval strategies. 
In work on sentence verification, the semantic structural representation 
of an input sentence is the central feature of the model, hypothesized 
processes being concerned principally with either operations on the 
input to generate the semantic structure or matching operations on the 
generated structure (Clark, in press; Trabasso, 1971; Olson, 1971, 1972). 
Different models which are compared in this research often (but not 
always) differ principally in the semantic representation posited. 
Computer models (e.g. question answering systems) must specify some 
formal representation for semantic information. The specific semantic 
representation adopted has usually been dictated more by the sort of 
"limited logic" programs designed to operate on the semantic information 
(cf . Winograd, 1972) than by the semantic properties of natural language 
which have been described by linguists. However, Simmons (1972) has 
let semantic characteristics of English be the principal, basis for 
constructing his graph-structure' representation of English, and Schank 
(1971) has been concerned with the general characteristics of a semantic 
representation and semantic analyzer without being bound by limitations 
of computer technology. Crothers (1970, 1971) and Frederiksen (1972) ■ 
have been particularly concerned with comprehensively accounting for 
semantic properties of English at the discourse level. In developing 
the semantic model described in Chapter 9, we have been particularly 



13 



Tai: s 1.1 



Components of a Proce:: s Model for Comprehension 
and SeruEntic Memory 

1. Structural model of semc;:ntic information stored in LTM 

a. Semantic structur : 

b . Logical structure 

c. Operators 

2. Selection processes 

a . Surface (incl . syntactic) 

b . Semantic 

3. Interpretive processes 

a. Surface structure generator (incl. morpheme recognizer) 

b. Parser (syntactic processor) 

c. Semantic interpreter (encoder) (incl. retrieval and matching 

processes) 

4» Generative processes 

a. Retrieval from semantic LTM 

b. Operators on semantic inforniation 

c. Matching processes 

5. Storage and retrieval processes 

a. Short term memory buffer 

b. Retrieval: undirected search 

c. Retrieval: directed search (incl. operations on semantic 

information) 



6. Operations on semantic information 



a. Lexical 

b . Transformational 

c . Presuppositional (generative) 
.d. Inferential (generative) 

e. Elaborative (generative) 

7 . Matching (verification) processes 

a. Identity match (iiicl. scanning) 

b. Transformational match (incl. oper^itions on semantic information) 

8. Output expressional processes 

a. Surface structure generator 
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Table 1.2 

^ - ' a 

Tasks for - roce£ :^odels, have been Construcred or Appl ied 

a-iG r rs Pr . anting Models for each Task 

(RT indicates t data, considered were response rimes, RES indicates 
that data :: ns red Vz^:a coded responses) 

A. List le :n.- 

1.. Ge:- models . Reitman (1970) 

2. Re:al_ and recognition: Anderson and Bower (1972a) RES 

3. Org ^.nization in free recall: . 

Kintsch (1970, 1972)* RES 
c. Ruminelhart, Lindsay, and Norman (1971)* RES 

B. Sentence perception 

1, Bever (1970) RES \, . . 

C. Sentence verification 

1. Clark (1972), Trabasso (1971), Olson (1971, 1972): structural 

( viz . negation, locatives, comparatives, active and 
passive sentences) RT 

2. Collins and Quillian (1969): conceptual comparisons* RT 

D. Judgments of semantic acceptability of sentences 

1. Kintsch (1972) RT 

E. Recognition confusions in sentence recognition 

1. Anderson and Bower (manuscript) RES 

F. Question answering 

1. Clark (1972) RT 

2. Winograd (1972)* 

3. Raphael (1968)* 

4. Bobrow (1968)* 

5. Norman (1972)* 

G. Non-verbal ' reconstruction: following instructions 

1. Wincgrad (1972)* 

H. Readinr rate and "proposition retention": discourse 

1. Kintsch (1572) RES, RT 



Table 1.2 (cont.) 



i. Base comprehension task: verbal reconstruction 

1. Fredefiksen (1972, present report) RES 

2. Crothers (1971) RES 
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concerned with representing both semantic and logi :al properties )f 
natural language discourse by means of a limited set of well-def i:ied 
isemantic and logical relations and operators on these relations . 

2. Selection processes . Selection processes refer to any operations 
which serve to restrict that information which is to be processed. 
Selection processes are necessary to account for any failure to process 
all features of the input and thus are central to any account of speech 
perception. The strategies of speech perception described by Sever 
(1970) involving segmentation, determining relations between clauses, 
and labeling input segments are examples of selection processes. 

Bever describes strategies which are both surface (i.e. determined 
by surface characteristics of the. input string) and semantic, Olson 
and Hildyard (1972) have considered selection processes in verifica- 
tion tasks and have proposed ,that the analysis of .an input sentence 
will reflect only those decisions about the input which cannot -be made 
prior to the input of the . sentence • Thus information is selected 
from the surface structure which is relevant to decisions which cannot 
be specified a priori on. the basis of context. To the extent that they 
involve incomplete analysis of inputs, computer parsing routines also 
involve selection, processes (cf, Winograd, 1972).- Semantic selection 
could occur if the parser were under the control of a semantic proces- 
sing component of the program, 

3, Interpretive processes . Interpretive processes are responsible 
for "decoding" the input string resulting in a syntactically processed 
and semantically interpreted informational input. Interpretive pro- 
cesses have been a major constituent of virtually every model, Winograd 
(1972) presents a review of computer parsers and a description of his 
own parser which utilizes semantic operations as a part of the inter- 
pretive process (e,g,;, to resolve ambiguities). Winograd's parser is 
also unique in its use of "systemic grammar" (Halliday, 1967, 1970) 
■which is designed to provide an heuristic input to a semantic system, 
Winograd 's semantic structure into which the parser maps, is not 
particularly well developed from the standpoint of a generally applic- 
able semantic description of English discourse, Bever's (1970) accounts 
of processes in speech perception assign a central role to syntactic 
processing in segmentation of the input string, and also considers 

the semantic interpretation to be important in speech perception. 
Sentence verification models always consider the transforming opera- 
tions which are required to make a "semantic match" between two 
inputs. These operations include syntactic (e.g, ■ passive to active) 
as well as semantic operations, Clark (in press) considers generative 
processes (generation of presuppositions) in his models for sentence 
verification (e,g,, re. different types of negation). The model which 
will be developed in Chapter 4 supposes that both interpretive and 
generative processes occur at input. In the present work, a central 
question will be to determine what task characteristics, induce a person 
to process textual inputs "interpretively" or "generatively". 
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A. Generative processes . Generative processes refer to operations 
which result in seniantic elements being incorporated into the semantic 
structure (associated with a linguistic Vnput) which were not "present" 
in the input in linguistically coded f ormv . Generative . processes 
include retrieval of semantic information corresponding to input 
lexical elements, operations on stored semantic information (e.g. 
inference), and^matching processes involved in the verification of 
generated semantic information against ''data" selected from the input. 
The computer models which have been suggested are essentially inter- 
pretive processors, although Winograd's (1972) parser allows for the 
semantic -component to intelligently augment the parsing. Rummelhart, 
Lindsay, and Norman^ s (1972) program treats retrieval as "rational" 
(i.e. directed search), and Kintsch (1972) considers the transfer of 
information from a memory buffer to LTM in list learning tasks to be 
systematically based on retrieved semantic information corresponding 
to lexical elements of the list. Clark's (in press) models for sen- 
tence verification involve the generation of presuppositions corres- 
ponding to certain input sentences and the use of the generated presup- 
positions in matching against a second input. Three authors have 
emphasized the importance of -generative processes in language compre- 
hension and memory. Schank (1971) regards comprehension as a prediction 
problem involving the generation of a semantic model of an input. "In 
order to effectively analyze a given linguistic input, it is necessary v 
to make predictions as to what the input might look like, compare 
the actual input to the expected input, and coordinate both with 
the memory model" (Schank, p. 109). Kintsch (1972) focuses on infor- * 
mation storage and retrieval problems and argues that for economy of 
storage, semantic structures will be stored from which information 
can be generated (e*g.) by means of inference rules. In the present 
work, we will be especially concerned that a model be capable of 
accounting for the frequent occurrence of inferences in subjects' 
free recall protocols. The model presented in Chapter 4 involves 
generative processes both in semantically interpreting linguistic 
inputs and in generating semantic elements not corr esponditig to expli- 
citly coded input elements. To determine whether or not generative 
processes involving inference and elaboration were occurring at input , 
in Chapter 6 we will analyze correlated growth, in reproduced (corres- 
ponding to input semantic elements), inferred, and elaborative seman- 
tic response measures by fitting alternative stochastic growth models 
associated with alternative assumptions about the occurrence or non- 
occurrence of generative processes at input. to the data. The results 
will be seen to support the notion, that generative processes do occur 
at input . . 

^' Storage and retrieval processes . Storage'and retrieval processes 
are involved whenever input Information is processed, since processing 
takes time and thus information must be stored in order to be processed. 
While memory models developed to explain list learning phenomena are 
available (e.g.. Reitman, 1970; Anderson and Bower, 1972a; Atkinson 
and Shifferin, 1971), models which consider the structure of stored 
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semantic information and which consider memory processes in compre- 
hension have been proposed only recently (cf . Collins and Qulllian, 
1969; Rummelhart, Lindsay, and Norman, 1971; Kintsch, 1972; Anderson 
and Bower, 1972). Among psycholinguists, there appears to have been 
an unwillingness to seriously consider memory processes in comprehen- 
sion at all (e.g. Carroll, 1971). Of the above models of "semantic 
memory" processes, Rummelhart et al, (1972) and Kintsch (1972) have 
attempted to use their models of semantic memory structures in con- 
junction with process assumptions to account for free recall list 
learniug results; and Anderson Bower (1972) have been concerned in 
addition with accounting for recognition memory for sentences. All 
of the above models of semantic memory processes incorporate (1) a 
process for "maintaining input" (rehearsal), (2) a limited capacity 
short term memory (STM) or buffer storage, and (3) a long term memory 
. (LTM) of practically unlimited capacity and the contents of which 
may be represented by means of a semantic structural model. The 
models differ in their treatment of the role of STM limitations in 
the selection and definition of what is stored, the role of retrieval 
processes during input, the kinds of retrieval processes considered v 
(e.g. directed vs. undirected search 'of LTM, development of retrieval 
cues), bases for forgetting, matching processes, and of course the 
structure in LTM which is searched. In the present research, recall 
protocols will be obtained after repeated exposures to a discourse 
to facilitate the systematic study of processes by which a memory 
structure is ''built up" in LTM and the role of previously stored 
semantic structurea in the acquisition of new information. 

6. Operations on semantic information . Operations on stored semantic 
information are involved in retrieval; in semantically interpreting ' ^ 
Input lexical elements;, in transforming input information (e.g. by 
applying; operators to previously input relational structures); in 
inference: inferring relational structures from previously input 
relations, or from structural representations of lexical elements, or 
both; in generating presuppositions (highly probable "inferences"); 

and in generating elaborative relational structures. To the extent 
that models have been "interpretive" rather than "generative", opera- 
tions on stored semantic information have not been considered (especial 
ly during input) or have been considered only, in a limited way. In 
addition to the work discussed under "generative processes above, 
operations on stofed semantic information have been a central compon- 
ent of computer question-answering systems such as those of Bobrow 
(1968, algebra story problems); Raphael (1968, limited logic re. 
jUr^.r'.^.^rients of set relations, part-whole relations, etc.); and Winograd 
0*1^/'., spatial relations). 

7. Ma tchin)^ ( verification) processes . Matching processes have been 
extensively studied in the research on sentence verification, much of 
which has already been discussed. In addition to this work, Anderson 
and Bower's (1972b) computer program extensively develops matching 
processes as it tries to find paths in a semantic structure in LTM to 
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correspond to a structure which is input. A particularly interesting 
problem which they deal with is that of imperfect matches involving 
semantic ''trees'' in LTM which imperfectly correspond to input, "trees" 
and the use of this imperfectly matched information in subsequent 
processing. 

8. Output expressional pr ocesses . Output expressional processes are 
involved in linguistically encoding semantic information to express 
acquired or generated semantic information as discourse. Expressional 
processes have not been considered seriously in most work on compre- 
hei.sion since either the tasks used do. not involve meaning reconstruc- 
tion, or (especially in computer models) ' output expressional processes 
are not of immediate interest to the author. There appears to be a 
growing consensus that a model of comprehension cannot be based on 
processes of speech production and that a linguistic description 
based primarily on considerations of speech production is not likely 
to be optimal for purposes of developing, a semantic representation 
of natural .language. ^ 

One of the principal shortcomings of process-oriented research in 
comprehension and semantic memory is that either the models suggested 
have a good basis in experimental data but are limited to very specific 
tasks, or they are less task-restricted by have a very poor basis in 
empirical data (especially the computer models) 

1.5 Effects of . Surface and Semantic Properties of Discours es and 
Discourse Contexts 

Much of the voluminous research on language comprehension and learning 
from "meaningful verbal discourse" has been concerned more with deter- 
mining what properties of linguistic material c;r fa'ctors ±n the context 
within which the linguistic material is presented are related to the 
"degree" or "amount" of comprehension or learning which takes place 
in response to an input discourse rather than with determining the 
seq\ience of processing operations which take- place pr the representa- 
tion of information in LTM. Carroll (1971b) has prepared a very exten- 
sive review of that literature on comprehension and learning from 
discourse from the former point of view. While much of the research 
reviewed by Carroll is not process-oriented, the results are important 
to the extent that they identify specific characteristics of discourses 
or discourse-contexts which affect outputs related to the processing 
of that discourse. * Carroll's review includes topics such as the 
following: (1) studies identifying properties of single sentences 
which affect performances involving those sentence types such as: 
length; grammatical structure including: phrase structure constituents, 
grammaticalness, grammatical 'homplexity", syntactic anomaly; semantic 
anomaly; relative roles of sjmtax and semantics; order of approxima- 
tion to natural language; (2) studies of effects of factors of content 
and organization in discourse; (3) studies of effects of stimulus 



modality (visual vs. auditory presentation); (4) studies of effects 
of other presentation factors such as speech rate, compressed speech, 
and distractions during listening; (5) studies identifying variables 
affecting (long term) learning from discourse (usually measured by 
multiple choice tests or verbatim recall) such as (a) "meaningful" 
vs, *'rote" insti'uctions; (b) intentional vs, incidental learning;, 
(c) effects of ^'advance organizers" and other kinds of contextual 
information or instructions; (d) effects of length-time relationships, 
word frequency, and repetition; (e) effects of content, organization, 
sequencing, and other semantic characteristics of a discourse; and 
(f ) post-presentation variables such as delay of recall and recogni- 
tion. Carroll's review is extremely useful as a catalogue of charac- 
teristics of linguistic inputs and task characteristics which have 
been found to influence performances based on these inputs, Carroll's 
review does not consider recent work on linguistic semantics relevant 
to comprehension, recent work on semantic information processing, or 
more recent work on semantics and comprehension reviewed by Clark 
(in press). Carroll^s review also does not consider developmental 
studies or research cbncerned with inferential^ processes in language 
processing. It is interesting to note from Carroll's review the 
almost total ^absence of systematic experimentation on effects of 
semantic-structural proper ties of ^ discourse on comprehension and 
memory. Of the studies which are reviewed, the most relevant to this 
problem are those concerned with establishing that information con-^ 
cerning syntactic "deep-structure" characteristics of sentences is 
used in understanding or remembering those sentences, and those 
attempting to show that in recognition subjects make confusions be- 
tween sentences which are similar in meaning ("gist") but differ in 
"deep structure." The paper of Clark (in press) thoroughly reviews 
research employing verification and question-answering tasks with 
the objective of identifying a process model and semantic representa- 
tion which is capable of explaining performance on these tasks; and 
Fodor and Garrett (1966) have reviewed experimental work concerned 
with establishing a relationship between the "derivational complexity" 
of sentences (re. generative transformational grammar) and processes 
in sentence comprehension and memory. 

A number of recent studies are concerned principally with the structure 
of semantic information in LTM and are not described in the previously 
cited reviews. These include: *^Kintsch*s (1972) experiments on seman- 
tic acceptability of sentences and on reading times for sets of propo- 
sitions (Kintsch and Keenan, 1972), Anderson's (described in Anderson 
and Bower, 1972b) experiments on recognition confusions m sentence 
memory, and recent work on sentence verification (Trabasso, 1971; Olson, 
1971, 1972) and on verification times .for semantic relations defined 
on word pairs (Collins and Quillian, 1969; Rips, Shoben and Smith, 1972; 
Smi'th, Haviland, Buckley, and Sack, in press) 'Kintsch (1972a) varied 
both semantic properties of sentences (definitional, contingently true, 
contradictory, and nonsense) and syntactic form (copula-noun, copula 
adjective, and verb), and measured true-false verification tlmes# He 
found that "if subject and predicate are strongly related in an accep- 
table sentence, reaction times are faster (definitional sentences). , 



than if the relationship is less close (contingent sentences); for 
unacceptable sentences this relationship is reversed." Kintsch 
found no effect of syntactic form class. A process model was also 
presented to account for more precise quantitative properties of 
the data. The studies of Collins and Quillian (1969) and Rips et 
al. (1972) also explore the hypothesis that processing times may 
reflect seniantic properties of elements stored in LTM. In the case 
of Collins and Quillian the structural, feature of information stored 
in a semantic network in LTM studied is the number of nodes inter- 
vening between two concepts. Rips et al. argue against the network 
definition of '^semantic distance" but their argument appears to 
indicate o^Xy that Collins and Quillian 's network is not sufficiently 
complex. The general result is that as semantic distance is in- 
creased between the subject and predicate, reaction times for judg- 
ments of semantic acceptability increase. In another study (Smith, 
et al., in press) » evidence was obtained from measures of response 
times for t^rue-false verification of previously learned noun- 

number pai^s in which the nouns were organized hierarchically into 
classes, which was interpreted as indicating that both storage space 
and retrieval complexity determine what retrieval process was adopted 
by their subjects — direct retrieval (directly reflecting the otgan- 
ization of the noun hierarchy) or deductive retrieval (opera ting 
deductively on the noun hierarchy) . 

In another Experiment designed to demonstrate that the propositional 
base (semai^tic) structure of a sentence has demonstrable effects on 
processing time, effects not attributable to such surface features 
as length and syntactic factors, Kintsch and Keenan (1972) measured 
reading ti^^es fo^" sentences of constant length and differing propo- . 
sitional (semantic) structures.) When reading time wa% plotted as a 
function number of propositions recalled, it was found that each, 
added proposition increased reading time by an approximately constant 
amount. Internal analyses of the data indicated that the effect was 
not entirely due to syntactXc factors. These experiments leave little 
doubt that Semantic characteristics of lexical items > sentences, 
and discourse have important effects on performance. 

Anderson (reported in Anderson and Bower, 1972b) has attempted to 
obtain data from recognition memory experiments which could help re- 
solve the issue of what surface sentences to consider to be synonymous, 
i.e. membe'^s of the paraphrase set represented by a single semantic 
structure it\ Ll^> by examining recognition confusions in sentence 
memory. Xh^ task which Anderson employed was a f our-alternative 
forced choice recognition task where his interest was in comparing 
false alar^ii rates for different incorrect choices. The assumption 
was that if two sentences are mapped oi^to the same semantic structure, 
they will confused. in later recognition if, first, separately 
stored syntactic information is **wiped out*' by exposure to interpo- 
lated mate^^ial during the delay between presentation of a sentence * 
and presentation of the "probe'^ s^entences. On the basis of his results 
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Anderson concluded that the range. of surface forms which ought to 
be regarded as "equivalent" is mych broader than one might expect. 
However, there are reasons^ to*^ reserve judgment on such a^ conclusion 
which is based entirely on sentenc^ recognition data. The use of 
memorial techniques to assess strubtural identity of representations 
of sentences stored In LTM has been^ criticized by Fillenbaum (1970) 
on the grounds that evidence based on confusions in recognition are 
only indirectly related to the underlying representations in LTM. 
That recognition confusions can reflect specif ic events in sentence 
comprehension <and reci^gnition which in turn affect what is stored 
is illustrated by Tieman's (1971) dissertation in which different 
instructions ( viz . "remember the wording" vs. "generate images") were 
found to have a greater effect on recognition errors for comparative 
sentences than did properties of the comparative sentences employed. 
In view of the difficulties involved, in making absolute statements 
about the form of information stored in LTM from sentence recognition 
studies, it may be desirable to consider bther tasks which may provide 
more direct information concerning the structure of semantic informa- 
tion stored in LTM. 

Sentence verification tasks have also been employed to infer proper- 
ties of the representation of linguistic information resulting when 
a sen^tence is comprehended (cf . Clark, yin press).. The method adopted 
assumes that a person's reaction time is a sum of durations of proces- 
sing times for independent serial processes associated with "encoding" 
input information into internal representations and with matching 
these representations against other representations. The form of the 
internal representation obviously plays a major role in determining 
the series of . operations involved in interpreting inputs and in match- 
ing (e.g.) representations generated for pairs of sentences. As in 
the case of sentence recognition studies, the natur^ of the represen- 
tation in LTM appears to be influenced by specific characteristics 
of verification tasks. For example, Trabasso (1971) has fit alterna- 
tive process models for the verification of negative sentences (a 
"response change model" and an "optional recoding model"y to new data 
and to previously reported data from a variety of sentence verifica- 
tion studies and concluded that ^Jt^ects adopt alternative processing 
strategies depending on characteristics of the tasks and sentences 
processed which are related to the number of options or alternative 
states open to , the subjects. Clark (in press) independently came to 
the same conclusion comparing identical models (which he called "true" 
and "conversion" models of negation). Olson (1971) has investigated 
this problem developmentally finding that the "recoding strategy" 
occurs letter than tbii "response change strategy". He concluded that 
'"the number of mental operations is determined 'by the set of alter- 
natives consider^^a by the listener-reader". In another stufly, (Olson 
and Hildyard, 1972) processing times for verifying active and passive 
sentences were considered to depend only on the time required for 
decisions which cannot be presupposed prior to presentation of a 
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sentence. In this experiment the voice of the verb of the sentence 
being verified was specified by the context (by "f oregrounding'^ 
with the resulting decision time associated with voice being reduced 
to zero. Thus, there is" substantial evidence from sentence verifi- 
cation studies that the extent of processing of sentences, and hence 
the form of information resulting from those processes, is related 
to specific informational characteristics of a task and context- 
related presuppositions. The resulting conclusion that the form in 
which semantic information is represented in LTM is a relative matter 
is an important contribution to our knowledge about comprehension. 
The possibility remains that there is a "most probable" form ^hich 
occur under a great many task and contextual conditions. If this 
is so, then it would seem to be important to attempt to determine 
the probable form of semantic representations resulting from compre-^ 
hension of sentences embedded in atural discourse contexts and 
unaffected by the processing of subsequently presented probe inputs. 

It may help in identifying just what combinations of tasks, measures, 
and experimental variables have been studied in research on compre- 
hension to present a systematic classification of tasks, response 
measures, and independent variables which have been used (or may be 
<^ used) to study information processing in comprehension and semantic 

ihemory. The classification in Table 1.3 is by tasks, response measures, 
and independent variables lending themselves to. experimental manipu- 
lation. The tasks are classified first as involving either a choice 
response or a free verbal response , and second as involving either 
single inputs or multiple inputs . Within this general two-way classi- 
fication specific tasks are identified. Not included in the free 
response tasks listed are those requiring verbatim reconstruction 
(since they do not meet the minimal requirement for demonstrating 
comprehension — paraphrase) and those tasks which alter the base 
task of uninterrupted presentation of an input discourse. It may be 
seen that practically all research on comprehension has employed choice 
/ ^response tasks . This fact seems to be in part due to lack of an 

adequate solution to the scoring problem discussed previously. Measures 
which may be obtained are classified with respect to the task for 
which they can be obtained — choice response tasks or free response 
tasks. For choice response tasks, both response patterns and response 
times have been employed. The variables identified in Table 6 for 
single inputs include^ surf ace (e.g.- grammatical) characteristics 
and '.semantic characteris ti'CS . The great majority of psycholinguistic 
studies have been .concerned with grammatical or certain semantic 
characteristics (e.g. negation, locatives, comparatives) of single 
^ , sentences. Also considered have been characteristics of inputs such 
as word frequency, length, and "imagery value". An unsolvable design 
problem for experiments attempting to manipulate input variables 
such as these is the mutual inter-dependence of discourse characteris- 
tics which is built into languages and which makes it impossible to 
manipulate one independently of another. For example, it is virtually 
impossible to vary a semantic characteristic of a linguistic input 
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Table 1.3 

Tasks, Response Measures, and Independent Variables for the 
Experimental Study of Information Processing in 
Comprehension and Semantic Memory 

TASKS 

I. Choice Response Task 

^- Single input ; verification of semantic acceptability 

B. Multiple inputs : ■ 

1. probe retrieval recognition 

choice recognition 
question answering: yes/no 

2. verification match/no match 

choice verification 

II. Free Response Task 

A. Single input : 

1. paraphrase.. 

2. meanitig reconstruction 

3. operations on input, 

4. reading time 

B. "" Multiple inputs : 

1. question answering: wh-questions 
2., structured deletions 

3. meaning reconstruction ■ 

4. operations on input ' ^ 

5. reading time 

MEASURES 

I. Choice Response 

A. Response pattern : | 

1» binary 

2. multi-category 

B. Response times 
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Table 1.3 (cont.) 

II. Free Response 

A. Reproduced structure : 

1. surfa'^e features 

2. logico-semantic features 

B. Generated structure; [classified by operations which gen- 

erated the structure] 

1. sur-face features 

2. logico-semantic features 

C. Serial order in output 
D • Response times 

INDEPENDENT VARIABLES 

I. Single Input 

A, Surface characteristics : 

1. length 

2, surface structure 

B. Semantic characteristics : 

1. content conceptual 

relational 

2, .structure semantic 

logical 

C . Temporal conditions 

D, Structured deletions * 

E, Respor ;e required at input 

F. Context 
II. Multiple Inputs 

A . Single i nput variables for each input , \ 

\ 

B • Relations between successive inputs ; \ 

1. identity . \ 

2. surfacie transformations 

3. semantic relations 

C • Temporal conditions between successive inputs \ 

D- Interpolated material 

1. none 

2, present 



without also varying a* surface characteris 
some limited freedom to pick surface sente 
. phrase set^' associated with a single seman 
satisfactory solution to this problem appe 
strategy of ''representational design** (Bru 
sampling linguistic inputs from a set of i 
only the syntactic or semantic property wh 
and which vary with respect to other chara 

In the present research, we have worked en 
tasks involving meaning reconstruction. S 
Measures obtained (including those describ 
of measures of reproduced structure, gener 
order in output. Experimental variables m 
context in which the input was presented, 
tasks, we eventually hope to be able to ge 
cerning the form and content of informatio 
resulting f rojn^ comprehension of sentences 
context, to be able to determine parameter 
and discourse contexts which affect the fo 
and to be able to gather information conce 
which occur in processing an input discour 

Research on language comprehension and s em 
free response tasks has been undertaken on 
(1970^,. .1971) and in the project described 
Although there has been research reported 
ties of dipjaourses consisting of multiple 
acquired ' from the discourses; with distort 
in remembering; and with effects of specif 
the content of a text, advance organizers^ 
instruction on recall of elements taken fX' 
review, and (e.g.) Frase, 1966; Dawes, 1^.6 
the tasks employed have been choice respon 
verbatim recall. This research also has n 
cedure for representing the "meaning" of t 
both Crothers' project and the present one 
done on the twin problems of developing a 
•representation of discourse and of scoring 
tically against cfie structural model of an 

Crothers (1971), working with single parag: 
pedla entries for nebula and oceanography , 
semantic representation which emphasizes a 
of the paragraph and which contains substai 
which is inferred, i.e. information which : 
in the surface structure of the passage bu' 
explicitly represented information. One o: 
undertaking a structural analysis is to de^ 
tation from which an "abstract*' of a passaj 
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by "pruning off" the more subordinate branches. Psychologically, 
this goal was motivated by the informal observation that in recon- 
structing a passage, one start:> with the "gist" (superordinate 
structure) and then proceeds to reconstruct the details (branches) , 
However, Crothers found that this "gist hypothesis" was not supported 
by his data based on the nebula and oceanography passages. Crothers 
also founcj that the related hypotheiss that "terminal (i.e. most 
subordinate) subtrees" are recalled less well than the main subtree 
was not supported by the data. In addition to these results, Crothers 
study found (1) that frequency of occurrence of a node within the 
structural' model of a passage (both explicit and implicit occurrence) 
was related to the number of subjects recalling a node, (2) that 
sentence order did nat appreciably affect recall, (3) that forgetting 
is not mainly restricted to embedded clauses in the surface structure, 
(4) that the major subtopics (hierarchies) were recalled independently 
of one another. The above results were based on an analysis of 
response patterns consisting of scores indicating whether a node was 
correctly recalled in a subject's protocol, 

1,6 Organization 

Part I of the present report presents results concerning the effects 
of experimental contexts which were obtained using the first procedure 
developed for measuring semantic information acquired ftom a discourse. 
Chapter 2 contains a description of the rationale for the study, 
reviews relevant research, and ouTlines the specific questions to be 
investigated and the sources of data relevant to these questions. 
Chapter 3 presents a description of the conventions which were first 
adopted for representing semantic structural information "contained" 
in a discourse and a description of the scoring procedures ^hich 
were developed based on these conventions. Also identified are the 
semantic c^lasses of responses in reconstructed discourse which result 
from the application of these scoring procedures. Interscorer relia- 
bilities of frequency scores based on these resprr.se classes are 
also reported. To facilitate description and Int .rpretation of our 
results, and to make explicit the process assumpL:.cns underlying the 
quantitative analyses of the data which wete under aken. Chapter 4 
presents a detailed description of the process mode^ which was developed 
during the course of the research. Considered in zhe model are 
processes involved both in generating semantic infcrmatipn from a 
.natural-language discourse and in reconstructing information acquired 
from a discourse. Relationships between specific processing operations 
and classes of response in reconstructed discourse are discussed. 
Two principal questions are identified with which the present study 
is concerned: the relative ex;tents and roles of interpretive vs. 
generative processing operations in "normal" comprehension, and the 
extent of invariance of these processes over characteristics of discourses 
and discourse contexts (process invariance). Chapter 5 presents the 
principal experimental results concerning the effects of discourse 
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conte::::? ^=:::=igned to inruce certain processing operations on semantic 
inforz^„:-r contained in a discourse, on response class frequencies 
xeflezti:rx^ the relative extent of specific processing operations 
Results :oncerning changes in these effects associated with repeated 
exposures to the discourse are also presented. 

In order to investigate possible alternative sources of observed 
growth in inferred and elabora.tive r.elations which might reflect the 
occurrence or nonoccurrence of generative processes during input, 
stochastic growth properties of repeated measurements of frequencies 
of different classes of semantic relations were also studied,' It 
was assumed in the analysis that if new semantic information is 
acquired at input and that generative processes do occur during input, 
then observed growth in subject-generated semantic elements should not 
be due solely to growth in the reproduced (explicit) structure. 
Alternatively, if the person behaves entirely as an "interpretive" 
processor j then subject-generated semantic elements will be produced 
only at output and thus observed growth in subject-gencirated elements 
ought to be attributable solely to growth in the reproduced structure. 
These two alternatives were* studied by fitting alternative Markov 
simplex growth models (Joreskog, 1970) to the matrix of Intercorrela- 
tions of frequencies of reproduced, inferred,' and elaborative semantic 
relations. Each stochastic model m :thematicaily expresses the 
quantitative consequences for correlated growth data of a particular 
model. The results are presented in Chapter 6.- In addition, effects 
of the experimental contexts on . the goodness-of-f it of the alternative 
mathematical models was found to be very informative. Since this 
.comparative model fitting technique appears to be useful not only for 
investigating alternative sources of growth, but also for investigating 
alternative semantic sttri^utural hypotheses, included in Chapter 6 
is a description of how linear structural models such as the Markov 
simplex mc ^ may be used to investigate semantic structural hypotheses, 
and a descxrsTrion of a generalized normal ogive model which should 
permit oni investigate such questions at the level of individual 
response pairterns obtained . for semantic structures cor re?^ ponding to 
particular sentences or sentence-sequences . 

Another tz:.:/^ question which will be studied in Chapter 7 concerns 
sources oxf xr: dividual differences in semantic information recalled 
or genera (£ind hence in the sequence of information pr cessing 
operations resulting in ths± information), and effects of character- 
istics of -courses and discourse contexts on sources of individual- 
differences Sources of individual differences may be investigated , 
correlation^Ily by obtaining measures of specific narrowly defined 
"abilities' and studying predictive relationships between these measures 
and measures obtained from scoring subjects' recall protocols. Analysis 
of the effects of discourse characteristics involves considering 
experimentally- induced differences in ability-response class correla- 
tions. A rationale for this approach has been suggested earlier 
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(Frederiksen, 1969) involving interpreting a high correlation between 
a specific ability measure and response class as indicative of the 
particular process or processes involved in generating responses of 
•--.that class. This method of studying individual differences in experi- 
mental contexts has been applied extensively in educational .research 
and has been labeled by Cronbach and Snow (1969) the "ATI*' approach 
f ot "aptitude- treatment-interact ion" . Thus, sources of individual 
differences were studied by attempting to predict frequencies of each 
class of response from measurements of abilities and studying the ' 
effects of the contexts on these predictive relationships. In the 
present research, processes in comprehension and memory were classi- 
fied into input linguistic processes, unconstrained generative proces- 
ses (associated with elaborative production) ,. generative reasoning 
processes (associated with inferential production), output expressional 
processes, storage and retrieval" processes, processes associated with 
buffer storage, and processes associated with the identification and 
maintenance of semantic elements. Ability measurements related to 
each of thase classes were obtained and used to predict response class 
frequencies separately for each experimental context. Data were 
also obtained to attempt to determine to what extent individual differ- 
ences/in strategies for acquiring and organizing semantic information 
occurred and to investigate context effects on such strategies. Pre- 
dictive relationships between strategy measures and response class 
frequencies were also investigated to determine which strategies were 
associated with specific classes of acquired senantic information 
and under which experimental' contexts. 

Part II contains a detailed description of the structural model which 
was developed to represent the logico-semantic structure of a discourse 
(Chapter 9) and a description of the scoring procedures which were 
developed based on the structural model (Chapter 10) . Some results 
obtained using this scoring procedure are also presented in Chapter 
10. Since an important aspect of this research has been the develop- 
ment of procedures for measuring semantic knowledge acquired from a 
. discourse, the descriptions of these procedures are intended to be 
as explicit as possible. 
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CHAPTER 2 • 

LEARNING FROM DISCOURSE IN ARBITRARY AND NON-ARBITRARY CONTEXTS 

By what process is an individual able to acquire semantic knowledge- 
from natural-language discourse? How and in what form is such acquired 
information stored for subsequent use? By what means is such stored 
semantic information made available for use in new situations long 
after it has been acquired? It is hard tc think of issues more 
central to an understanding of cognition, learning, and psycho- 
linguistics, especially when one reflects on the fact that most of 
the learning which takes place durinp. a person's lifetime occurs in 
response to verbally transmitted ii::::Lrmation: transmitted in messages 
usually consisting of more than one sentence. In fact, it is har^ to 
imagine a task which does not require a person to retrieve and use 
previously acquired semantic information. Given the obvious importance 
of. the capabilities referred to in these questions it is surprising 
how little is known about these processes. We do know quite a bit 
about the components of memory, but only very recently have students 
of memory begun to seriously inquire into the organizational properties 
of information stored in memory (e.g. Norman, 1972; Kintsch, 1972). 
While ~e do know that structural properties of sentences may be 
proce^iad at many levels»(e.g. Bever, 1970), we still lack an under- 
standLz; of the specific processing operations that occur which enable 
a perscrn to interpret single sentences semantically . At the -discourse 
level, even less is known about these processes. The usual Assumption 
appears to have been that a discourse would be processed in uRe same 
manner as the individual sentences from which the discourse is 
composed. Research oil language comprehension has tended to emphasize 
the immediate processing which occurs as a sentence is input and 
"understood," and not to consider seriously questions involving memory, 
such as: "How is stored semantic information made available for use 
in interpreting an input sentence?" and "By what processes does semanti 
information acquired from one sentence affect the interpretation of 
subsequent sentences?" 

It would appear^ then, that any satisfactory experimental attack on 
these problems will have to seek to identify specific processing 
operations that are involved, in acquiring and retaining non-verbatim 
(semantic) knowledge from natural-language discourse . Thus, from this 
point of v^w, an attack on these problems should simultaneously 
consider the psycholinguistic and the memorial aspects of the problem. 
These two aspects — the psycholinguistic, concerned principally with 
immediate processing of sentences, and the memorial, concerned, with 
processes of storage and retrieval and with the organization of 
information in long-^term memory — should both be incorporated in any 
attempt to model the processes involved in knowledge acquisition 
from discourse. 
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The next question, then, is "\>rhat sort of experimental task is most 
likely to ^complish these objectives?" A number of t^^sk character- 
istics are clearly necessary. First, the taskis •^.ciDuld involve the 
uninterrupted presentation of a iu ^ural-language discourse. Second, 
the conditions of presentation and the discourse itseli rhould be 
representative of naturally occurring discourses and o~ natural 
conditions in which discourses are received. Third, Swme assessment 
of the semantic information vnich has been acquired shcula be made, 
bcch immediately after a discourse has been presentee a^nd at the 
end of some retention interval. Assessment of acquirec knowledge 
can. be made in more than one way (e.g. probe retrieval: recognition, 
choice recognition, question answering; or recall: rec^l of items 
contained, in a presented discourse!, paraphrase, meanicE: reconstruction; 
see Table 1.3), but however the assessment is made, it is necessary 
that the semantic information contained in^ the input c"sco^'rse be 
unambiguously and completely specified. With the £xc^-..tirn of 
Crothers* (197 2) study described in Chapter 1, thnre been virtually 
no research on the acquisition r:: non-verbatim senantlc information 
which is contained zj\ a tezict ani rhich is . to be acquirec. However, 
there have been an extensive imsi^LHr of studies reported which are 
concerned in various ways with nsaningful verbal learning" In which 
the learning task does not involve verbatim memorization. Since the 
principal interest, in most of these studies has been in the effects 
of particular experimental variables on the amoilnt of "learning" from 
a discourse, in practically all of these studies only a single global 
measure of ''information acquired from a discourse" whs obtained. 
Since it is only by means of observations . of preci-sely what information 
an individual has acquired from a discourse that can infer how an 
individual has processed an input discourse in acquiring that informa- 
tion, these studies provide very little specific inf3mation about 
these processes. The studies do, however, provide a g-eneral description 
of the sorts of variables which effect various global indices of amount 
of semantic information acquired. For a review of c dies of the 
effects of such task variables as rote vs. "meaningf u:^ * instructions, 
length, time, frequency, repetition, organization, sequencing, length 
of retention interval, and„ incidental vs. intentional learning on 
various global indices ^of acquired semantic knowledge see Carroll (1972) 
and^Welborn and English" (1937). 

Among studies which measure "meaningful learning" by a single index 
of amount of ac^quired knowledge, certain studies of the effects of 
advance organizers, contexts, adjunct; questions , and other conditions 
which are designed to induce specific processing operations on 
semantic information contained in an input discourse are more informa- 
tive about processing activities in the acquisition of knowledge from 
discourse (cf.Ausubel, 1967; ^Rothkopf , 1962; Gagne and Wiegand, 1970; 
Carroll, 1972). The principal value of these studies is that they 
indicate that there are experimental conditions which have demonstrable 
effects on amount of non-verbatim knowledge acquired from a discourse: 
effects which appear to indicate that subjects' processing activities 



adapt to passage and text characteristics and that these activi:.:_e 
include a. variety of "superordinate" operations on the logicc- 
semantic content of a text* These studies include Rothkopf's :iT*-c:s 
of experimjents on the effects of interspersed questions design:.: 
induce particular processing activities in "meaningful learnir: ' om 
prose (cf. RothkD-f, 1972; Frase, 1968; Carroll, 1972) , Gagne 
Wiegand's (1970) r.tudy of effects of context sentences immediarsi 
preceding facts to be learned, Ausubel's (1960, 1967) studies ci 
effects of "advance organizers," and studies of interference e^ft- 
in acquisition of non-verbatim information f rom ^discourse. 

The rationale underlying Rothkopf/s experiments is that questi - 
interspersed in a text which, require that a subject search rec:: 
stored information acquired from, the text may influence a vari ■:. 
of processing activities which facilitate the acquisition of i. .. 
tion from the text. Thus, in Rothkopf 's view, a question hai= : 
sorts of instructive effect: a direct effect due to the increHS. 
likelihood that a subject will store the interrogated informa.z:i. 
and an indirect effect on "the various processing activities 
subjects engage in while confronted with text" (Rothkopf, 197 - 
The evidential basis for this claim is the finding that quest,. - 
affect the acquisition of information other than that narrowl 
required to answer the adjunct -questions. To make certain th::: 
acquisition of the interrogated information has no direct effeir : 
acquisition of information to be used to assess the second sor" - 
effect of questions, in a separate experiment subjects are tra^rf:;^ r. 
the "interrogated" parts of the text and then tested on the ot, 
parts to insure that no positive ' transfer occurs. In general, .. . -„::ive 
effects of questions on amount of information acquired which 
independent of the questions, were produced only by questions rr 
followed exposure to the relevant material. Rothkopf and Bist^. 
(1967) also found that the nature of the adjunct questions inf . _ led 
the nature of the specific knowledge acquired. Rothkopf has 
.deliberately avoided speculating about the particular processes " ..ch 
he is influencing in his experiments because of his feeling thaz 
conclusions in this area are limited by a lack of adequate experxmental 
measures . 

Gagne and Wiegand studied the effects of particular context sentences 
placed immediately before sentences expressing information to be 
learned. The contexts conveyed "superordinate , " "coordinate" (rel^i^ied) , 
or "unrelated" information, or no context was present. The conte^i.^ 
were found to affect recall differentially. Greatest recall was found 
with no context, followed by superordinate, coordinate, and* unrelated 
contexts in that order. However, no effects were observed on recognition 

Ausubel and his collaborators (Ausubel, 1960, 1967; Ausubel & - 
Fitzgerald, 1961, 196-2; Ausubel & Yousef, 1963, 1966) have argued 
that "meaningful" learning necessarily involves relating acquired 
information to previously acquired knowledge ("cognitive structure- ') 
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in a nonarbitrary and nonverbatim manner, Ausubel*s studies have 
not sought to specify the precise nature of these structures; 
rather they have attempted to facilitate '^meaningful" ' learning, by 
manipulating that knowledge which is available to ^a subject to 
which new knowledge can be related. His experiments, involve the 
presentation of ^'advance organizers" — introductory discourse 
material presenting new generalized concepts under which information 
to be learned can be subsumed, or clarifying distinctions which 
distinguish the new information from previously acquired knowledge — 
and investigating the effects of advance organizers on the amount 
of new information acquired. Results have generally appeared to' 
support' Ausubel^s notions concerning' the importance of advance 
organizers in the acquisition of non-verbatim knowledge from discourse. 

Since these experiments with advance organizers fall within the 
interference paradigms of list learning research and since the 
predicted effects have geneTally been f acilitative, it is of interest 
to determine .if there are conditions under which inhibitory effects 
can be produced. In fact, inhibitory effects appear to be rather 
difficult to produce in learning tasks involving nonverbatim learning 
from discourse. Inhibitory effects have been produced only with 
difficulty and only in s_tudies of retroactive interference (RI) . 
One major difficulty in this -drea is in defining a measure of the 
similarity ^of' the originally learned passage and the interpolated 
passage. Any adequate solution to this problem would appear to 
require a well^-defined semantic model of both the original and the 
interpolated passages. A second difficulty involves measuring the 
degree of learning of the original and interpolated passages What is 
needed is a means of precisely measuring that information which has 
been acquired from an Input- discourse, and that input information 
which has been altered or transformed as it is acquired. Furthermore, 
a taxonomy of "intrusions" is needed if one is to distinguish subject- 
generated semantic information from that information which is generated 
in response to the interplated passage. For these reasons any results 
in this area must be regarded as only suggestive. 

Few studies have Succeeded in demonstrating RI with connected discourse 
materials which have required substantive (non-verbatim) recall. Mehler 
and Miller (1964) presented lists of 'eight sentences for. free recall 
.and scored subjects' protocols with both verbatim and contetit criteria. 
Interpolated sentences were constructed to provide either syntactic 
interference (different groups were presented eight sentences at one 
of three degrees of syntactic similarity) "or semantic interference 
(eight interfering sentences representing each syntactic type in the 
original list were presented such that each interfering sentence was 
completely unrelated to the originals in meaning). Two degrees of 
original learning were used. Syntactic and semantic interference were 
produced when the verbatim criterion was used for both degrees of 
original learning. But when the content criterion was used. 
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substantial syntactic facilitation was produced at the lower degree 
of oJ^iglnal learning. Mehler and Miller interpreted their results 
as b^ing consistent with the idea that semantic information and • 
syntactic details were acquired separately (in that order) arid 
presuniably stored separately, 

EntwlQle a^d Huggins (1964) tested' engineering students on principles 
of electrical circuit theory which they had studied. Interpolation 
of a highly similar set or principles before testing produced 
inhibitory. effects. However, it is reasonable to suspect that there 
was ^ significant rote memory component to these tasks, Ausubel, 
Stager, and Gaite (1968) attemptad to produce conditions which would 
result in inhibitory effects of a second interpolated passage on 
nonverbatiiii knowledge acquired from a previously presented passage (RI).. 
They found that two variables, degree of interpolated learning and 
overlearning of the original material, both facilitated the retention 
of information acquired ' from the original passage. , They attributed 
the facilitating influence to possible rehearsal ir.d clarification 
of t^e original material induced by the interpolates message. 
Finally, crouse (1970) defined similarity, of , the orii^,nal and inter- 
polated te:<ts in term^ of similarity of questions geaerated from 
either passage (same questions, different answers). With highly! 
similar interpolated passages so defined, he produced a modest amount 
of rI. However, the answers to the questions which he used appeared 
to h^'^e an arbitrary (rote) character which make the study unconvincing 
as a study of "meaningful" learning. These studies of effects of 
advanced organizers, contexts, adjunct questions, and interpolated 
text^ leave little doubt that "contextual" 'factors, post-presentation 
factc?rsj and ' such , factors as Adjunct questions affect processing 
activities involved in acquiring semantic information from discourse, 
processing operations which appear to be substantially different 
from those operating in rote memory tasks involving discourse, 

A major' shortcoming of the studies which have been described thus far 
is tliat they provide very little information about precisely what was 
affected by the experimental conditions. For example, Rothkopf (1972) 
has C)b served that "serious theory building is at present limited by 
the sparse nieasurement techniques that are available to us. Anyone 
who has ever conducted an experiment on learning from written' text is 
struck by the mute and unrevealing posture of the reacier. The processes 
that ^ust be taking place have to be inferred frpm crude learning 
meas'^res or from inspection of time data in a very indirect manner" 
(p, 332). While there has been some theoretical work concerned with 
developing a process model for natural language comprehension and 
sema^^tic memory (see Chapter 1), it appears as if our ability to 
develop an adequate data base for such a theory depends on the 
development of an adequate procedure for measuring precisely what 
semantic information a subject acquires (or generates) when presented 
with a discourse. With the exception of Crothers (1972) study and 
previously described studies, of recognition memory for sentences. 
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there is very little research providing information concerning either 
the acquisition of specific semantic elements from a discourse or the 
effects of possible processing operations on presented semantic 
information which might be reflected in the presence of semantic 
information in subjects' protocols which is derived from, but not 
identical to, information which was explicitly coded in the presented 
text. However, there are two lines of work which are relevant to 
these problems, both of which have attempted to represent the semantic 
content of a discourse in the form of a relational structure which a 
discourse imposes on its conceptual classes and both of which have 
attempted to measure recall of specific semantic elements contained 
in a discourse. 

The first line of work (Dawes, 1966) stems from Bartlett's (1932) 
studies of global aspects of subjects' recall of semantic Information 
presented in a discourse (e.g. "conceptual complexity," "simplifica- 
tion," "structure"). Dawes was . concerned with investigating Bartlett's 
hypothesis that as the retention interval between presentation of a 
passage and recall increases, the semantic structural information ^ 
which is recalled will become simplified* and at the same time will 
acquire greater structure. His method involved presenting an essay 
which was constructed lo assert a number of set relations involving 
relations between certain conceptual classes. Dawes argued that the 
distortion of meaningful material which occurs in memory may be measured 
as transformations of the set relations contained in the presented 
material. The set relations which were considered by Dawes were 
nested' relations (in which one set is entirely contained in the other 
or in the complement of the other): identity (all elements in two sets 
or conceptual classes are in common), exclusioi. (no elemr ts are in 
common), and inclusion (all elements of one set are elements of the 
other); and disjunctive relations in which two Iclasses have some, 
elements in common but neither is included in tne other. ' The measure- 
ments which DfiCwes obtained in his recall experiment were total number 
of relations^ecalled correctly, a simplification measure (number of 
"overgeneralized" relations, . i.e. disjunctive relations recalled as 
nested minus number of "pseudodiscrimixiated" relations or nested 
relations remembered as disjunctive) , an accuracy score (number of 
correct relations minus number of incorrect relations), and a simplicity 
score (number of correctly recalled nested relations ^minus number of 
correctly recalled disjunctive relations). Subjects recalled the 
relations 'asserted in the presented passag'e either immediately or 
after a -two day retention petiod by listing all of the group relation- 
ships which they could remember. The "immediate" group was also 
tested after two days. Dawes '. results indicated poor accuracy, and 
t^iat simplification occurs, i.e. that distortions tend to yield ' 
simplification. He found no evidence to indicate that simplification 
increases with the passage of time. 

The second line of .work (Frase, 1969, 1972) is explicitly concerned 
with attempting "to understand, how the relationships among the words 
that represent ideas in a text control and maintain conceptual 
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processing, and consequently how they determine the knowledge that 
results from reading" (Fraae, 1972, p. 338). Prase's approach 
involves attempting to manipulate specific processing operations by 
means of prior adjunct questions and then to study the effects of such 
''contexts" on the acquisition (recall) of specific elements (words) 
contained in the presented text, Thus, Frase (1969)^ presented subjects 
with "essays containing five conceptual categories such that the classes 
formed a sequence in which adjacent pairs are-.^conriected by superset- 
subset relations. The subjects were told to. read each passage and to 
find and underline the infoirmation which was' needed to draw a conclusion 
typed at the top of each passage. A conclusion to be verified involved 
a -stated superset-subset relation between two conceptual classes whose = 
verification required the- subject to scan from one to four intervening 
classes (as specified by the input sequence). Following this procedure, 
subjects were asked to write down everything they could remember from 
the passage. Studied were the effects of the questions upon the recalls 
of each of the five conceptual categories. The basic assumption was 
that subjects would scan the passage for the information necessary to 
generate the transitive inference relevant to the to-be-verified . 
conclusion and process only minimally information not^ relevant to the 
conclusion. Frase hypothesized further that text points irrelevant 
to the conclusion would be less likely to be stored in memory-. Results 
were entirely consistent with Frase' s hypotheses; recall of conceptual 
classes between concepts connected in a to-be-verified message was 
greater than for the remaining irrelevant concepts. This result was 
also found to be independent of sentence order. Frase's results are 
important for their convincing demonstration that both context-induced^ 
processing operations and semantic structural characteristics of a 
text can affect the acquisition (and recall) of specific conceptual 
elements contained in a text. Since Frase based his results on an 
extremely simplified semantic structure, it would be desirable to 
investigate similar effects with textsT expressing a wide variety , of 
semantic structures. Before any general conclusions are possible, it 
will be necessary to obtain such results based on more realistic 
semantic structures aad to observe effects not only on recall of 
individual conceptual elements, but alfeoon the acquisition of structural 
semantic information as well. Such studies could be most informative 
about the role of cognitive operations at the semantic level in the 
acquisition of semantic information from discourse. 

The outlines' of a research strategy for investigating the processes 
involved in acquiring semantic information from discourse should now 
be reasonable cPear. It appears that if we are to progress in our 
knowledge of these processes, it will be necessary to have a method 
available for measuring precisely,, what semantic information Is contained 
in a text and, a method for measuring ' precisely what seintiitic information 
has been acquired from a text. If a semantic structural model of a 
text and an associated measurement procedure were available, then a 
research strategy could be adopted based on inferring the occurrence 
of specific processing operations in comprehension and semantic memory 
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from: (1) measurements of specific semantic information in subjects' 
recall protocols: information which was acquired from the presented 
discourse, transformed in specific ways, or generated by the subject 
himself in specified manners from the input; and (2) observations of 
the effects of particular contextual conditions designed to induce 
particular processing operations on these measurements. 

The present research has proceeded by first attempting to develop 
solutions to the twin problems of semantic representation of discourse 
and measurement of semantic information acquired from a discourse, 
and then attempting to apply the research strategy jiist outlined. The 
particular contextual conditions studied were designed both to induce 
certain inferential operations on text cont^ht. and to relate to the 
notion that much of the ^'arbitrariness" which seems to be present 
in many laboratory comprehension tasks is due to the lack of specific 
context-defined goals to "be attained in understanding and remembering 
information contained in a text. Thus, there may be an iiuportant 
difference between "reading** and "reading for a purpose," a difference 
which would appear to be likely to affect the types of heuristic 
procedures which subjects adopt in understanding and retaining semantic 
information contained in a text (cf, Freedle and Carroll, 1972). 
The three different task conditions adopted were designed to influence 
inferential operations on the input discourse, both quantitatively 
and qualitatively. The notion was that processes involved in acquir ing 
semantic information from discourse would be dependent on operations 
on the semantic information to be performed after the information has 
been acquired. The experimental conditions'Used consisted of an 
"arbitrary" condition in which subjects were presented with a recorded 
discourse and 'then asked to write their reconstruction of the informa- 
tion which they had acquired from the discourse, a problem solving 
("non-arbitrary") condition in which subjects were also required to 
generate for subsequent use as many different solutions as they could 
to a problem based on the content of the essay, arid an incidental 
memory condition not requiring reconstruction of the input essay. 
Subjects in the' first two groups wrote their recalls 'after each of 
four exposures to the discourse; subjects in the remaining group wrote 
their recalls only after the fourth exposure* 

The research reported in the subsequent chapters was designed to 
obtain data relevant to a number of questions concerning those Infor- 
mation processing operations which underlie the ability to acquire 
semantic information from discourse. Since thei:ie questions principally 
involve hypotheses about • specif ic processing operations which occur 
and since the. semantic analysis of subjects' recall pratocpls yields 
scores which appear to reflect the outcomes pf specific classes of 
processing activities, we ,found it desirable to develop first in' some, 
detail a general process model for use as a theoretical framework 
within which specific questions could be formulated. The four , 
specific issues which are described below cons titute the principal 
questions to be investieated in Part I of thiR 
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1, Process invar lance . There are two sorts- of questions Involving 
Invarlances which are of concern for a theory of natural language 
couprehenslon: structural invarlance : "To what extient Is the form of 
semantic information in long term memory resulting when a discourse 
is understood fixed or invariant?", and process invar lance : "To what 
extent is the sequence of processing operations which generate this 
seaiantic information 'invariant?" Both sorts of Invarlance can be 
considered with respect to a variety of task characteristics such as 
surface and semantic properties of discourse Inputs, temporal 
conditions, repeated exposures, and contextual conditions. The other 
side- of these questions is concerned with the effects' of such task 
characteristics on processing operations and semantic informati'on 
resulting from these processes. The problem is to determine those 
aspects of procesrlng which are under the control of discourse and 
task variables, and those aspects of the process which are relatively 
fixed or invariant. Studies of these questions will not onl-y help 
identify specific processes, which enable a person to extract semantic 
information from a discourse, but also will help to describe the manner 
in which these processes adjust. to characteristics of an input discourse, 
repeated Inputs, or disccurse contexts. The present research will be 
concerned principally with process invarlance., invarlance with respect 

to the contextual conditions which have been described and with 
respect to repeated exposures to an input text. 

2, Interpretive vs, generative processing . In Chapter 1, a distinction 
was made between a language processor which is "interpretive," i.e. 
capable of semantically Interpreting linguistically coded input 
Infoimatlon, and one which is "generative," i.e. capable of generating 
new semantic information from linguistic In^fts which are "semantically 
Incomplete" (which Incompletely code the sema.ntlc Information which is 
necessary to understand the text).^ A 'major question to be considered 
in the present research is: "To what extent do people process 
linguistic information generatlvely?" and "Can contextual conditions 
significantly Influence the extent to which people process a discourse 
generatlvely?" | 

3, Role of generative processes , SuppoW that the verbal recalls 
which subjects produce after being presented with a text mtaln 
relatively extensive semanti c IriormatloA which does no correspond 
to. information which was explicitly^ represented in the iuput text. 

The presence of such subject-^geaerated information implies that specific 
operations must have occurred to generate the information. An Important 
questlpn, given that generative processes occur, is to determine 
whether such processes occur as an input discourse is being processed, 
or whether a discourse is first processed Interpretatlvely with 
generative operations (such as deductive inference, presupposition, 
certain kinds of retrieval) occurring subsequently — during output if 
the subject's recall is obtained immediately after the discourse is 
presented. It is clear that generative pror.esslng capabilities are 
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necessary, for example, to successfully interpret ambiguous construe- ' 
tions such as in ambiguous pronominal reference and syntactic , ambiguity. 
The question being asked here isj "To what extent are generative 
processing capabilities involved beyond those minimally required to 
understand natural language texts?" A related question concerns the 
temporal locus of effects of contextual conditions on processing 
activities. Do the contextual conditions pr^uce differences in the 
extent to which textual information is processed generatively as it 
is received, or do the conditions affect primarily the mode and extent 
of subsequent processing activities? 

4. Sources of individual differences . A fourth kind of question is " 

concerned with sources of individual differences in semantic information 

recalled or generated ( nd hence with differences in the sequence of 

information procebjing ^rations resulting in that information) , and 

with effects of characteristics of discourses and contextual conditions 

on sources of individual differences. While studies of individual 

differences in>^language comprehension have tended to focus on outcomes, 

measuring differences in level of performance ori various comprehension^ 

tasks, the approach to individual differences taken here focuses on 

both specific outcomes and on sources of individual differences in the particular 

sequence of processing operations which generate those outcomes. Thus, 

for example, it is of interest to know if individuals differ in the 

extent to which they process texts interpretively or generatively. 

Sources of individual differences may be investigated correlationally 

by obtaining measures of specific narrowly defined "abilities" and 

studying predictive relationships between these measures and measures 

obtained from scoring subject;.^* recall protocols. Analyses of effects 

of contextual conditions and effects of, repeated exposure involve 

considering experimentally-induced differences in ability-response 

class intercorrelations , A rationale for this approach has been 

suggested sarlier (Frederiksen, 1969) involving interpreting high 

correlations between a specific ability measure and response class as 

indicative of the particular process or processes involved in 

generating responses of that class. 
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CHAPTER 3 

MEASUREMENT OF KNOWLEDGE ACQUIEED JKOM- A DISCOURSE 



3.1 In troduction 

The purpose of this chapter is to describe one procedure which has 
been developed for specifying a serantic structure for a connected 
logical .discourse and for objectively measuring the semantic infor- 
mation which results from comprehension and memory processes. The ^ 
procedure involves first, constructing a ''semantic structural model" 
of an "input" passage, and second^ scoring semantic or "ideational" . , 
features of a subject^s written rreconstruction of an input passage by 
fitting it to the "template" provided by the structural model of the 
input. This latter step involves the observation of a number of 
different types of response, each of which reflects different 
cognitive operations on 'the semantic structural features of the input. 
In developing a solution for the scoring problem (which might be 
described as a "template-matching" problem), it became increasingly 

" obvious that. any solution procedures iiievitably would involve a con- 
ception of the processes involved in compre' .^^nding and remembering 
discourse. This chapter will begin with, a' description of some general 
considerations involved in choosing to represent a text structurally 
as a logical network. It will then present a description of the 
relatively undifferentiated structural model adopted in the first 
stage of this, research, an application of this model to the analysis • 
of the text used in the' experiment whose results are described in 
Part I (Circle Island), and a description of the scoring procedures 
which are based on the model. The complete manual of instructions to 
scorers is found In Appendi- A. Result-ing from the semantic scoring 
of a subject *s i^rotocol'art a large number of observations or 
measurements which can be pooled or classified in a number of ways; 
Certain of these response classes are of theoretical interest since 

■ they are likel;^^ to represent the outcomes of different processing 
operations. A number of response classes employed in the present 
research will be identified. The basic data will consist of the 
relative frequencies of occiurrence of responses in each class. 
Theoretical interpretations of these classes of response will be 
presented in the next chapter. Finally, selected results obtained 
from an application of the scoring procedures to written protocols 
obtained from a sample of forty-seven subjects who listened to 
Circle Island and then attempted to reconstruct it will be presented., 

3.2 Structural Representation 'of a Text as .a Semantic Networ,k ■ 

Supp'ose that a subject is presented with a connected passage which is 
sufficiently long that any complete reconstruction of the surface 
features of the passage is rendered extremely difficult. Suppose 
also that after hearing the passage read, the s.ubject is asked to 
'write down his reconstruction of the semantic content of the passage. 
The problem which confronts us is that of measuring or evaluating the 
extent to which the "meaning" of the input passage is preserved in 
the subject's written protocol. This" problem obviously presents a 
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number oil difficulties , difficulties which upon reflection appear to 
center around the following two problems. First, define and represent 
the "meaning" of the passage given only its surface characteristics. 
Second, obtain objective and replicable measurements of the "corres- 
pondences" between the "jtieanings" of the passage a..d the "meanings" 
conveyed by the subject's protocol given a well-defined representation 
of the input passage but only the lexicographic surface structure of 
the subject's protocol. 

The notion that the "semantic content" of a stimulus discourse might 
be represented structurally in the form of a directed graph (cf . Harary, 
Worraan & Cartwright, 1955) has already been suggested by Dawes' (1966) 
experiments on the distortion of meaningful written mterials in 
remembering, and Frase ' s c{ 1969) demonstrations of the effects of 
thinking- about particular relations between pairs of concepts con- 
tained in a passage on recall of elements taken from the passage. 
Dawes' work was based on a passage constructed mostly of simple 
declarative sentences expressing set relations and attempted to measure 
distorion in memory by reference to the set relations specified in 
the passage; Frasa's experiments incorporated -the idea that textual 
materials be represented in terms of networks of set relations 'Which 
may be represented as directed graphs (cf. , e.g., Harary, et al . , 
1965). Graph-structures also have been employed in computational 
linguistic work which attempts to represent the semantic content of 
English sentences in computer code (Simmons, 1972) and in computer 
models which attempt to simulate various results involving the 
senia^itic properties of lexical items as processes of retrieval from 
a f:emntic network (e.g., Quillian, I968). Other work in linguistic 
Sr^rnantics has employed, various forms of predicate logic in representing 
propositions underlying English sentences. As Simmons has observed, 
"these forms 'are alternate representational conventions, and the choice 
of conventions for semantic representation need have no relation to c 
the resulting- power of the system" (1972, page 73)« A major reason 
foi' choosing a graph representation in which concept-nodes are con- 
nected by directed line-segments (arrows) representing semantic 
relations is that it is easier to apply in representing discourses 
consisting of many sentences and in scoring semantic information 
acquired from a discourse. The predicate notation becomes unbearably 
difficult to read as the number of embedded predicate arguments and 
connected concepts increases. Also, as will be argued in Chapter % 
t: fact that a predicate notation can be used does not mean thct the 
piopositions so represented *'fit" nicely*into any available sys\Vm of 
predicate logic. Thus, in the present work, /it was decided to enuTierate 
set relations (of various defined types) and .to represent these 
relations in networks of directed graphs. Any semantic network can 
be easily converted to a computer code by simply representing each 
relation as a function defined on concept pairs as arguments (cf. Simmons 
1972). \ ' 

From the point of view of 'its function in communication^^ a discourse 
can be seen, first, as a means by which^ a speaker can specify a set 
of conceptual categories by 'means of a set of lexical designators and, 
second, as a means by which he can specify a set of semantic relation- 
ships which he asserts relate (connect) the specified conceptual. 
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categories. Thus a speaker can in general communicate conceptual and 
relational, information by using a set of lexical designators (content 
words) which are assumed to be shared with the listener, to indicate 
or mark a set of conceptual categories; and by using shared rules of 
syntax, syntactic markers, and rules of e>;i)ression to indicate or 
mark the relational information which connects the concepts. In 
addition, the speeiker may assume shared knowledge about the world and 
shared ability to operate cognitively on that knowledge in deciding 
what conceptual and relational information to express (and what not 
to express directly). Comprehension^ from this point of view, involves 
the listener's attempting to ^'infer" that conceptual and relational 
information which the speaker is attempting to communicate from the 
surface utterances of the speaker and. given this shared knowledge. 
If this general conception of linguistic communication is correct, 
then the problem of representing the -"meaning'^ underlying a discourse 
can have no purely formal or linguistic solution since in a. sense the ■ 
meaning underlying a discourse is the conceptual and relational 
information inside the speaker * s .head. For example, a speaker may 
use a lexical label to indicate a concept which he wishes to communi- 
cate, but the label may be imperfect as exemplified perhaps by later . 
references to aspects of the concept no't commonly associated with the 
lexical label* Or, a speaker may mark relational information 
connecting conceptual classes incompletely or arabiguously . IL would 
appear, 'then, that the problem of specifying a semantic network- 
underlying natural language discourse will have to' be limited in a 
number of ways if it is to be made tractable. 

One can, at this point, set different objectives for a structural 
representation of discourse. A stringent objective adopted by some 
computational linguists is to develop a method of semantic analysis 
(which may possibly be programmed on a computer) which is capable of 
"transforming strings of language into unambiguous relational 
structures of a cognitive model'* (Simmons, 19^8, page l) with the 
ultimate objective of being able to generate English sentences from ■• 
the model. A less stringent (and .more pragmatically motivated) 
objective, is to develop a' structural model which represents the 
^'essential" conceptual and relational structure of a passage (as in 
"precis-writing") including some /features which may not be, explicitly 
expressed in the passage, but which is not necessarily capable of 
generating a surface structure identical to that of the original 
passage, A reasonable way to place limitations on the task of 
developing a semantic network representation of discourse when the 
stringent objective is adopted is to take the lexical elements (con- 
tent words) as the concept-nodes in* the graph structure and to make 
no attempt to analyze them 'further. These elements might, for 
exaimole, be regarded as entry points to a long term memory structure,- 
in which information about lexical elements is stored. The "meaning" 
of a discpurse in such an analysis consists entirely in this res- 
tricted case of the relational information which a discourse imposes 
on its lexical elements., This approach' runs into a number diffi- 
culties including a failure to account for the' fact that conceptual 
information associated with a lexical element may be contextually 
dependent. Nevertheless, this approach to semantic analysis has been 
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adopted in Part II of this report. Additional problems with such an 
approach to semantic analysis will be identified in Chapters 9 and 10. 

The approach to be described in the present Chapter was to adopt an 
objective closer to the second less stringent alternative. Just 
what constitutes "essential logical features^Vis admittedly a somewhat 
subjective matter.; we do not require that a structural representation 
be unique, onlj^ that it be logicall;!^^ consistent, well-defined, and 
capable of generating the essential semantic structure of the passage. 
Furthermore, it was felt that a represen1;^.tion satisfying the more 
stringent objective would most certainly come much closer to repre- 
senting the surface chare.cteristics of a discourse and would be 
likely to represent a fineness of meaning which may not be desirable 
if one's purpose is to describe and measure the conceptual and 
relational information which subjects acquire from a discourse. 
Finally 5 a more differentiated classification of types of relations 
and a more detailed analysis of conceptual elements can be ^^'^de at a 
later.'time, even if the network itself does not so represe. o concepts 
"and^releti.ons. For e ample, all .aat 's needed to identify relation 
types nc represented individually in the model is to list all 
examples of the type^^ occurring" in th'"- model. 

For the purpose of generating a representation of a text, in terms of 
a network of set relations, in the present approach concept-classes 
are defined from which the relational structure of an essay can be 
generated. The concepts so-defined may be represented in the ,surface 
text as word groups (e.g., noun groups^ verb groups, preposition 
groups, adjective groups, cf. Halliday, I967, 1970; Winograd, 
1972), as predicates, 'as embedded (relative) clauses, as certain 
unanalyzed comparative constructions, or as entire independent clauses. 
In the analysis of Circle Island (see Figures. 3. 1-3.8) , a noun group 
which functions as the semantic subject of an. independent clause was 
always taken as a single concept . In sentences containing no relative 
clauses 5 the predicate was taken as a single ^conceptual category. 
Sentences often were paraphrased, both systemmatically (e.g., as 
active sentences, with pronouns replaced by their antecedents, com- 
pound sentences broken up)' and more freely by making lexical substi- 
tutions to simplify the semantic representation (e.g., '^Circle Island 
has a shortage of water" changed to "Circle Island has little water") 
before conceptual categories were defined. Preposition groups 
specifying location were defined as conceptual elements,, as were 
relative or comparative constructions (e.g.j "north of Ronald Island" 
"Much more prosperous, than the farmers"). Verbs were represented as 
concepts only when they had noun equivalents (e.g., export, goveriiraent, 
decision) or when the remainder of the predicate contained an embedded 
clause (e.g., "pointed out that"). Thusj for example, the stative ■ 
verb "want" was represented as a single concept followed by an embedded 
"goal" clause. Predicates represented as concepts assert such semantic 
relations as possession, attribution, class inclusion, affected object 
or person,, and identity. Semantic subjects function as agents or 
instruments of an action, or as conceptual classes to be further 
differentiated by predicates asserting attribution, sub-classification, 
etc.-^ Predicates inay als9 combine several of these semantic functions. 
Relative clauses were not analysed in tne analysis of Circle Island 
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with one exception: relative clauses which represented a ''theme'' 
resulting from the action ''pointed out^' were analysed. 2 Thus, syntac- 
tic features of the passage were often used in the. definition of 
concept classes. Unless concepts are Identified with lexical items, 
some rather arbitrary decisions of this kind will probably be neces- 
sary for many textual materials. Wliile most of the. concepts defined 
in the manner just described can be further differentiated (i.e., 
themselves broken into set. relations), it was felt that for the 
purpose of scoring conceptual and relational information acquired 
from a text, the concepts selected were sufficiently fine to represent 
mamy' important set relations contained in the passage. 

Once a set of conceptual categories has been defined for an essay, 
the graph structure may be specified by indicating- with directed lines 
the relational links between concept pairs. The relational links 
designated are of four kinds. First, semantic relations are defired 
which differentiate concept sets ' specifying new semantic information 
which is asserted to characterize or apply to the members of these 

sets. A semantic relation A' > B is any directed relation which 

specifies either a state B of an object, being or, event A (such as 
location,\ tj.me, attributes, possession, class membership, degree^ and, 
manner); or a relationship involved in an event (action), such as 
agency, instrumentality, object or being affected, goal of an action 
prior or resulting state, location, time, manner, and thematic content. 
These different functions of a relation are not differentiated in the 
graph structiire. In the present model, a relation may represent more 
than one of the functions listed above. Second, bidirectional relations 

or identity relations are defined. An identity relation A <— ■> B 

asserts that two concept sets are identical and may be substituted, 
one for the other. Any two concepts connected by a semantic relation 
or identity relation constitute a proposition. In the-. present analysis 
a proposition is always taken as asserted to be true.-^ The third kind 
of "relation, the conditional relation^ A > B,. connects any two 

propositions, and asserts that the truth of one proposition B is 
conditional on the truth of a second antecedent proposition A. 
Conditional relations include assertions of causal dependency, logical" 
implication, or siJTiple conditional dependency. A conditional relation 
can' often be expressed as an "if . : - then" construction. In" the 
graph structure, conditional relations are drawn connecting the 
terminal concepts of their respective 'propositions. The fourth kind 
of relation is the bidirectiona:l conditional relation or bidirectional 
implication: "if and only if." This relation^ denoted A < > .B, 
may be read "A implies and is implied by B" and does not occur in the 
Circle Is l and passage. 

A diagrammatic model may be constructed from these concepts and 
relations linking concept sets which are represented as phrases 
in the diagram. "Represented in the model are concept-sets: in 
particular, (l) explicit concepts (concepts which are explicitly 
stated in the original passage); (2) certain inferred concepts 
(concepts which, while not stated directly, enter into relationships 
with explicit concepts which are necessarily true); (3) certain 
illustrative elaborative concepts (concepts which are not stated 
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directly and do not enter intd relations with explicit concepts which 
are necessarily true). Also represented in the model are set relations, 
consisting of semantic relations and conditional relations, in parti-, 
cular; (U) explicit semantic relations; (S) explicit identities 
(bi-directional relations, A '"is identical to" B);, \6) explicit 
conditional relations (if A, then where A ana B are propositions 
consisting of set relations); (7) explicit bi-directional implications 
u(A "implies and is implied by" B); (8) inferred semantic relations and 
conditional relations (relations which, while not stated directly, 
ar.e necessarily true within the context of the passage); (9) elabora- 
tive semantic relations; and (lO)elaborative conditional relations. 
The decision was made not to represent separately different .types of 
semantic relations and conditional relations, not to attempt any 
representation of qualifications (e.g., "may," "might"), and to ^ 
represent instances of negation in terms of negative concept sets. 
Prom the diagramma-tic model, every concept and relation expressed [in 
the original passage may be reconstructed. Each concept and relation 
in this diagram is identified by a code number which is used in 
scoring subjects' protocols by reference to the model. Such identi- 
fication permits further classification of concepts; relations, and. 
implications by listing. Note that it is not in general possible to 
represent in the model all implied relations and implications, 
expecially since such relations or implications" can involve concepts 
not stated explicitly in the passage. This situation, a property of 
• logical systems 5 necessitates certain complexities in scoring' which 
will be discussed later. 

The complete text of the essay Circle Island is presented in 
Appendix A. This essay was adapted from the essay used by Dawes 
(1966) and consists mostly of simple declarative sentences. The 
graph structure of the essay is presented in Figures 3.I to 3.8. 
This graph structure is the template against which a'subject^s 
reconstruction of the essay is scored. 

5 

3 . 3 General Description of Scoring Procedures 

To obtain objective, replicable measures of the "degree of correspon- 
dence in meaning" between a subject *s Written protocol and the 
structure just described, one runs into certain complicating factors. 
In principle, a subject's protocol is itself analyzable logically and 
is representable in terms of a network. Thus^ in principle, the 
scoring problem involves measiaring the degree of correspondence of the 
two structures. In practice, this procedure is exceedingly difficult 
to objectify. The method which was adopted, attempts to ri:ake the 
structural analysis of subject's protocols objective by using the 
input structure as a model or "template" against which a subject^ s 
protocol is fit. The result is a " structiaral representation of the 
subject'^ protocol based on its fit to the template. In most cases, 
this representation should be derivable from a structiaral model of 
the subject's protocol constructed by an independent logical analysis. 
To" illustrate the sort of complexity one encounters in "template- 
matching/' consider the following exajnple. .Suppose ARB is a relation 
present in the input (where R is a directed 'relation from concept A 
to concept B) and a relation A'R'B' be identified with a relation ARB 



contiiined in the model of the input , and given such identification/ 
how might A'R'B^ differ from the relation of the model with which it 
is identified? ' Consideration of this problem (which represents a 
relatively siiaple exemplar — complex cases involving;, for example, 
embedding and nesting can occur) led to identification of certain 
possible subject transformations of an input triple ARB (see Figure 3*-9)- 
To provide a means for identifying a set relation in the subject's 
protocol with one in the model, the following condition was ' established, 
A set relation in a subject* s protocol is i^entif icable with a stated 
set relation in the input passage if the concepts and relations in the 
protocol may be transformed into those in the input passage by one 
of the transformations ^listed in Figure 3«9« The treatment of inferred 
set relations presents additional complexities, since it is not in 
general possible to enumerate all possible relations inferrable from 
the model, especially those involving subject-generated concepts. 

The treatment of thes and other scoring problems involves a considera- 
tion of the protocol produced by a subject as the result of a sequence 
of processing operations and relations between ARB and A'R'B.' 
(exemplar^ ought to be describable in terms of classes of responses 
resulting from the application of particular processing operations. 
A description of a model characterizix://, these processes will be 
presented in. the next chapter. Of particular interest in the present 
context, is a classification of certain processes in comprehension and 
memory for\ connected discourse (see Figure S-IO)? since these provide 
a rationale for- the scoring procedures to be described. According to 
this conception, comprehension involves the construction of a'logicc- 
semantic model of an input passage. Four sorts of process are 
identified: selection processes (e.g., selection of an e].ement of 
the input string for further processing, generative processes (e.g., 
encoding, generation of an element of a semantic model) , and verifi- 
cation processes (establishment of a correspondence between an 
e^lement generated and an element input), and transformation (opera- 
tion on the generated semantic model to change its conceptual and 
relational --structure. The classes .of processes identified in 
Figure 3*10 correspond rather directly to classes of scores obtained 
in matching a subject's protocol to the template. For example, 
verification of identity by the subject yields a concept in the 
subject's protocol which is identical to one. in the input. Verifi- 
cation of class correspondence yields a. concept which may be over - 
specified (concept-set overly delimited, i.e., representing a subset 
of the concept-set of the input) or incompletely specified (concept- 
set not completely delimited, i.e., includes subsets not corresponding 
to the concept-set of the input), and verification of implication 
yields, a concept which does not correspond to any concept of the input, 
but which enters into derivable relations with concepts of the input. 
Note that these types of verification each determine a particular 
unique correspondence between an element produced (encoded and Sub- 
sequently reproduced) by the s.ubject and an element of the input. 
Note also that a similar classification may be made for more complex 
elements present in subject* s protocols such as relations, inrplicatio.ns, 
'■ or structures (systems of relations). .Having briefly indicated the • 
•rationale for our scoring system, the description of our procedures 
for template-matching" can be concluded. 
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A,B are. input concepts 

A,B may- te explicit or 
inferred 



MODEL.: 
PROTOCOL: 



AEB 
A'R'B' 



1. 
2. 
3. 



R is an input relation 
R may be: explicit inferred 
— -> - - - -> 



Semantic Relation 



Identity Relation <- 



Conditional 
Relation 



k. .Bi-directional 
Implication 



<= 



-> < ^> 



POSSIBLE SUBJECT TRANSFORMATIONS ON: 



CONCEPTS 




RELATIONS 


A* = A [no transformation]' 


R' 


= R [no transformation] 


A) = A+ [incompletely specified] 


R' 


= M'(r) [mode trans form^ition] 


A* = A- (overspecif led) 


R' 


=D(r) [direction transformation] 


- (/> [null transformation] 


R' 


= I(r) [identity transformation] 


The same transformations may- 


R' 


= M^D(r) [mode and direction] 


be applied to concept-set B. ^ 




= M*I(r) [mode and identity] 




R^ 



• ' ■ _ ; 

Figure 3.9. "Summary of symbols used in representing connected dis'course 
as directed graphs consisting of networks of set relations, and of 
possible subject transformations. 
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A. ELEMENTS OF SEMANTIC MODEL 

1. Concepts (Classes)^ 

2. Relations (Simple, compound, nested) 

3. Implications (Simple, compoimd, nested) 

h. Structures (Systems of relations, implications) 

B. PROCESSES 

1, Selection Surface (Non-criterial) 

Inferential (Criterial) 

2, Generative Operations Interpretive (Encoding) 

Inferential 
Elaborative 
Null 

3, Verification Simple Identity 

Class Correspondence 
Implication 
Non-Contradiction 
^ Null 

h, Transforination 



Figure 3 • 10 

Classification of possible elements of semantic model and processe 
in comprehension, memory, and reconstruction of connected logical 
discourse. 
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The semantic scoring of subjects' protocols against the constructed 
model of the input- passage involves three steps: verbatim scoring, 
concept scoring,, and relations • scoring. Verbatim scoring of ' a protocol 
involves reading the protocol and underlining every item of a fourteen 
item list of verbatim concepts, each .of which" occurs in the input 
passaga. Each verbatim concept is scored as either: correct (ver- 
batim criterion);., incompletely specified (if a portion of the verbatim 
concept appears); or absent. Total verbatim elements correct and 
incomplete are obtained. These totals are the basic verbatim data 
and are obtained for each subject for each trial. 

Concept scoring involves underlining and scoring each of a list of 
concepts which appear in the original passage and which are numbered 
and -diagrammed in the model- The scoring sheets contain a list of 
niambered concepts section-by-section. Each concept is scored as 
correct, incompletely specified, or over-specified. These scores 
may be thought of as transformations of the input concept by the 
subject. Concepts appearing in a subject's protocol are classified 
as explicit, inferred, or elaborative and are so identified on the 
scoring sheet. An additional scoring- sheet is provided for listing 
Bll (subject-generated) inferred and elaborative concepts which do 
not appear on the previous sheets. . Each concept which-'is explicit 
is scored as correct, incompletely specified, over-specified, or 
absent; each inferred or elaborative concept is scored as present 
(meaning subject-produced) . Totals for each concept type and scoring 
category are obtained for each section (the sections- correspond to 
serially located paragraphs in the input passage) and for each trial; 
This procedure yields a rather large number of scores which represent 
amount of inforrcation, accuracy of information, and transformations 
on information in the input. Difficult scoring situations sometimes 
occur involving such aspects as: stating conditions distinguishing 
situations in which the "over-specified" score category is used vs. 
scoring the concept and the additional words as an additional 
(subject-produced) inferred or elaborative concept; and stating 
conditioi.s for the substitutability of identities and the treatment 
of embedded verbatim concepts (verbatim concepts which are embedded 
in other concepts). (See Appendix A, section lO). 

Set relations .^coring is considerably more complicated than concept 



scoring and, if.e the concept scoring, involves scoring a subject's 
protocol against the structural model of the original passage. . As in 
the concept- scoring, set relation scoring consists of categorizing 
a set relation in a subject's protocol' in terms of transformations on 
a set relation in the model with which the set relation in the protocol 
is identified, A set relation in a subject* s protocol is identifiable 
with a stated set relation in the input if the relation appearing" in 
the protocol may be transformed into that in the input passage by one 
of six possible transformation (see Figure 3.9). Possible, transfor- 
mations on a relation R are: no transformation; . transformation of 
mode (relation to implication and vice versa); of direction (for 
unidirectional relations or implications); to or from an 'identity' 
(i.e., a unidirectional relation may become bi-directional, and vice 
vercia); mode and direction; and mode and "identity." Four possible 
transformations on a concept are: no transformations, incomplete 
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specification of the concept-set, over-specification of the concept-set, 
or deletion. Each triple consisting of two concepts and a connecting 
set-relation, which appears in a subject's protocol and is identi- . 
fiable with a set relation in the input passage, then represents one 
of 96 possible score patterns. In addition, set relations may be 
explicit, inferred, or' elaborative. - An elaborative relation i? not 
scored "transformationallj'-,'' but only as to whether or not it contra- 
dicts the semantic content of the passage. The .scoring sheet for each 
protocol contains 'a list of numbered relations (as rows) and three 
columns headed R', A', and B'. In columns A' and E^the appropriate 
transformations on A and B (corresponding to the nmbered relation in 
the model) are recorded as previously obtained in the concept scoring. 
Th^n a judgment is made as to what transformation has been applied 
to R und this transformation is- recorded. To illustrate some of the 
complexities which can occur in scoring relations and implications, 
two, sorts of problems for which detailed scoring rules are necessary 
may be mentioned. The first involves the. scoring of conditional 
relations involving compound concepts. The scoring procedure involves 
rules for breaking such relations ^nto parts, or, if this is not 
allowed under the rules, for scoring the transformation on the compound 
concept (see Appendix A, section 12). The second complexity involves 
the treatment of nested relations. As an example of the kind of 
scoring rule adopted tohandle such complexities, see Appendix A, . 
section 12, "Nested Relations." 

A sample of a subject's protocol is provided in Figure 3'11; "this 
protocol has been scored and the coded scored protocol is given in 
Figure 3»12. Since virtually every concept and set relation produced 
by a subject in his protocol is scored and recorded, a tremendous 
variety of classes of responses may- be obtained by counting frequencies 
of occurrences of given response types. For example, for explicit 
relations there are 5^ = 3 x 3 x 6 possible . score patterns. If 
concepts or relations are further differentiated, then .the number of 
possible score patterns for a triple consisting of two concepts and 
a relation increases by multiples. Certain classes of responses 
are identifiable as the results of processing operations specified 
in the model for comprehension-memory-reconstruction processes which 
was described earlier. A list of response .classes obtained from 
frequency counts cf various pooled semantic scores and corresponding 
to performances resulting from specific comprehension and memory 
processes is found in Figure 3 •IB. These score classes may represent 
rather direct measurements of the operation of specific processes in 
comprehension and memory. 

3.4 Results . ' 

The passage in Appendix A was presented to kj subjects by means of a 
tape recorder. All subjects were undergraduates at California State 
College at Hayward and there were 18 males and 29 females in the 
sample. Subjects were told that the material which they vrould hear 
would consist of a passage which describes a socio-political problem 
on an hypothetical island, involving a canal,* a threatened civil war, 
and the probable collapse of the island's economy, and were asked to 



\ 



60 



Figure 3.11 
Repro duction of a Scored Protocol 



COrrDITION SUBJECT SEX ■ • . 

Oi|05 1 102IR111 

I 100101 ^3 '■ 1 

CIRCLE ISIM D IS A SMALL ISIAND NORTH OF ROKALD ISLAND/ ITS INHABITANTS 
' IT ^ 13 

ARE EMPLOYED IN RANCHING AND FARMING/ THERE IS NOT MUCH Wk..^( AVAIIABLE/ 
11+ 25 20 10 

SO THE FARMS ARE SMALL/ THE RANCHERS (WHO RAISE BLACK ANGUS CATTLE HAVE 



29 30- 21 26 I k7 



LARGE ENOUGH RANCHES SO THAT TtlEY MAY EXPORT SO ME CATTLE/ THE ISLAITO IS 
39 37 51 !+2+ 2. 

GOVERMD BY A SENATE (COMPOSED OF THE TEN BEST PROVEN ADMINISTRATORS THE 

TEN RICHEST MEN/ ALL OF THESE MM ARE RANCHERS/ A SCIENTIST PROFESSOR 
^2 57 21 S7 

OLIVER RECENTLY DISCOVERED A CHEAP WAY TO COIWERT SALT WATER TO FBESH 



71 74 



WATER AND CALLED IT SALINE .RECYCLING/ THE FARMERS WANTED TO TAKE ADVANTAGE 
r " : ^72 TBT 79 

OF THIS PROCESS BY BUILDING A CANAL ACR OS S THE ISLAND/ THEY FORMED A 
J ~ : 88 . STL. 

■ GROUP OF FARMERS CALLED THE PROCAML GROUP/ THE RANCHERS OPPOSED THIS ■ 
J ■ " ■ ' \ ' ^ 21 95^L 

IDEA BECAUSE THEY SAID IT WAS ECOLOGICALLY UNSOUND/ THE PROPOSAL WAS PUT 
J~ ' 99 102+ [ L 

TO A VOTE/ AND THE PROCANAL GROUP WON/ THE SENATE THOUGH WOULD ONLY ALLOW 
J 119 * ' . 55 13^+ 

A CHANNEL T WO FEET -WIDE AND O NE FOOT DEEP TO BE BUILT/ THE CANAL WAS BUILT/ 
• 135 1. ro V - 



BUT ENGINEERS FOUND (THAT NO WATER ViOULD FLOW INTO THE CHANNEL/ TliE PROCAN AL 
13^ " 137 ^ 

GROUP WAS UPSET AT THIS/ AND CIVIL WAR NOW TI-I REA.T ENS THE ISLAND/ 

J B3 "^52+ ' m 

END OF PROTOCOL 1 FOR THIS SUBJECT 
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I. DISCRIMIMTION 

62 

A. Concepts 

1. veridical (A) 

2. overgeneralization (A+) 

3. pseudodiscriinination (A-) 

B. Semantic Relations - . 

' 1. veridical ARB 
2 . overgeneralization 

A+RB, ARB+, A+RB+, A-.RB+, ' A+RB- ^ ^ • 
3- ■ pseudodiscriinination 

A-RB, ARB-, A-RB- . 

C. Conditional Relations 

1. ARB 

2. overgeneralization 

A+RB, ARB+5 A+RB+5 A-RB+, A+RB- 
3- pseudodiscrimi'nation 
A-RB,-ARB-, A-RB- 

II. INFERENTIAL PRODUCTION ■ 

A. Concepts . 
1. . inferred concepts 

B. Semantic Relations 

1. inferred semantic relations among explicit concepts 

2. inferred semantic relations among inferred concepts 

3* inferred semantic relations including inferred concepts 

C. Conditional Relations 

1. inferred conditional relations among explicit propositions 

2. inferred conditional relations ajmong inferred propositions 

3. ' inferred conditional relations including inferred propositions 

III. ELABORATIVE PRODUCTION 

A. Concepts 

1. ela"borative concepts 

B. Semantic Relations 

1. elatorative semantic relations which are not false 
.C. Conditional Relations 

1. elatoratove conditional relations which are not false 

IV. TRANSFORMATION 

A. Semantic Relations 

1. transformations on R where R is a semantic relation 

2. false sulDject-produced semantic* relations 

B. Conditional Relations ^* 

1. transformations on R where R is a conditional relation 
2., false sutject-produced conditional relations 
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Figure 3-13 

Classes of responses in reconstructed logical discourse. 
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recount in writing what they had heard. They were also told not to 
attempt to write a verbatim reproduction of the passage. 'Subjects 
heard the passage four times, writing their reconstructions of it 
immediately ' after each exposure . One. week later, the subjects 
returned to take a mamber.of ability tests, and, at this time, a fifthl 
reconstruction of the passage was obtained. 

Three sorts of results based on these "data will be described in this . 
chapter: results concerning inter-scorer' reliabilities, results 
concerning mean response-class frequencies for particular classes of ■ 
structural elements (concepts, relations, implications) , and multi- 
occasion intercorrelations of certain response class frequencies. 
Consider first the results concerning inter-scorer, reliabilities 
summarized in Table 3.1. The response classes studied correspond to 
response classes identified in Figure 3.13- Inter-scorer reliabilities 
were estimated conservatively by double scoring the first and third 
'trials. of fourteen protocols. The second scorer^s experience consisted 
only of a reading of the scoring manual, and a short training session; 
the .scorer was familiar with the general nature of the research. To 
increase response class frequencies for purposes of estimating inter- 
scorer reliability, scores on the two trials were pooled for each 
protocol. The results indicate rather good agreement among scorers 
for response classes having relatively high frequencies. It is 
interesting that the inter-scorer reliability for veridical relations ' 
is about as high as for complete verbatim concejpts , since/the former 
score represents a scoring judgment which is far more complex than the 
latter. Note that not every response .class of Figure 3.13 has been 
analyzed; some scores were inadvertently omitted from our analyses. 
The data for inferred and elaborative relations suggest that the 
scoring decisions associated with this distinction may be made more 
objective. The difficulty appears to involve deciding whether or not 
relations involving subject-produced concepts are implied by relations 
present in the passage. This appears to have been one of the most 
difficult scoring decisions. 6 The general picture of these results 
concerning inter-scorer agreement appears to be quite promising, a 
result which is rather remarkable given the complexity of the scoring 
task. Objectivity appears to have been achieved to a large measure 
by the specification of very detailed decision rules for difficult 
scoring situations. 

Mean response-class frequencies for each trial are plotted in Figure 3-1^ 
for a number of classes of structural elements varying in complexity 
from concepts,. to semantic relations, to conditional relations. A number 
of observations are suggested by these plots. 

1.^ Consider the center graph, trial 1. It is. striking to note that 
the frequencies of oyergeneralized and inferred relations are about 
as great as that for veridical relations. Thus, for long passages 
given only one hearing, it would appear that verification of class 
correspondence or implication is about as likely as simple verification 
of identity. This result suggests that inferential processes are an 
integral part of comprehension, especially for long passages in which 
encoding of surface features is difficult. When this result is compared 
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to the result (on trial l) for conceptual-elements, it appears as if 
the result occurs only for th'e more complex structural elements (the 
relational structure). This result appears to provide a rather power- 
ful argument for obtaining a structural representation of the semantic 
content of a subject^ s protocol. 

2. There appears to be a rather large increase in the extent of 
identity verification and hence (interpretive) generative operations 
(or encoding) with repeated exposure to the passage , an increase which 
is reflected in the change in frequencies of veridical concepts and 
relations over t. als. 

3. There is an increasir -oortion of inferred and elaborative 
elements relative to verid. elements as the elements -become more 
complex, i.e. from concepts to semantic relations connecting concepts, 
to conditional relations connecting propositions. 

k. The frequencies of various response-classes involving conditional 
relations are very low, a result which is certainly due to the relatively 
low rate of occurrence of conditional relations in the input passage. 
A passage containing well-developed, conditional dependences would 
have to "be used to study processing of conditional relations. Such 
a passage will be used in Part II. 

5. ' Transfonaations also occur infrequently. Any detailed investi- 
gation of transformations will certainly have to make their occurrence 
more frequent. In addition, a more detailod classification of trans- 
formations based on a more detailed semantic model would be desirable. 
For example J an important transformation which may occur with greater 
frequency is that involving confusion of causal and logical conditional 
relations. In factj these tv;o cases were pooled in the present 
scoring procedures. , . 

6. Finally^ there is a suggestion of an increase In elaborative and 
inferential production in reminiscence and a definite decrease in 
"simple" production (frequency of veridical elements present).. 

Multi-occasion correlations of response class frequencies based oh 
veridical, over generalized^ -pseudo-discriminated, inferred, and 
elaborative semantic relations are presented in Table 3-2 (fifteen 
measures are correlated and so the tabla has three parts).' In 
examining this Table, we will consider separately the 5 x 5 -within 
response-class correlation sub-matrices along the diagonal and the 
between response-class correlations which constitute the. remaining 
parts of the matrix. In Chapter 6 procedmres for fitting mathematical 
models to this matrix to investigate hypotheses concerning its 
structure will be described. Consider first the intercorrelations of 
frequencies of veridical semantic relations across the four trials and 
reminiscence trial. A simplex pattern of correlations, greater for 
adjacent trials and least for trials farthest removed, may be seen to 
occur for the first four trials. Such a pattern is common .for longi- 
tudinal growth data and for measures which change stochastically over 
occasions. Note that the level of within resp'onse-class correlation 
is relatively high within the constraint of the simplex structure. 
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Now consider thi between response-class correlations. The striking 
fact here is the extent to which thf^se measures are independent. 
Multi-occasion intercorrelatior • " ^:5ponse class frequencies based 
on inferred, transformed, and eli,. '\ \e semantic and conditional relations 
are presented in Table 3.3 to illu^.rate dependence ^..jross elements 
processed. Correlations involving conditional relations may be some- 
what attenuated due to the lov7 frequency of occurrence of these 
response classes. The simplex structure which appeared for the first 
four trials in the previous matrix also appears here. Some degree of 
correlation occurs for particular response-clashes across elements " 
processed (semantic or conditional. relations) , ^specially for trials 
occurring, in close temporal proximity." There is a relatively strong 
indication of independence among different response classes as before. 
If these results are isubstantiated in future research, the implication - 
would be that multiyvle processes in comprehension and me:aory are 
operating relatively independently, and that measui^ements of "compre- ■■ ^ 

hension" must certainly be multidimensional. 

Further ana]7ses of these correlation matrices have recently, become 
possible due to the recent developm^'nt of numerical estirriation procedures 
which permit the fitting of a wide class of mathematical model' to 
a correlation matrix. For example, it Is of theoretical intere.st to 
determine whether generation of inferred structural elements is a 
growth process over trials, implying that processing operations in 
comprehension involve the gradual construction of a "semantic model" 
from indepe:. .ently produced elements which are the result of either 
interpretive or inferential generative * operations or, alternatively, 
inferentially geherated elements are built up of. semantic elements 
which are first "built into" the semantic structure by processes of 
semantic interpretation. If. this latter alternative holds, then som.e 
argument might be made that infe: .tial processes whould not neces- 
sariljr^^ be considered a part of . prehension , but rather as representing 
fuz'ther procet ,ing of the semantic structure built up in comprehending , 
a passage. Suffice it to say "cliat each of these alternatives has 
aosociated vrith it a particular mathematical model ^^enerating the 
simplex . -^operty, an-fL that a comparison of fits of the two models 
may be made. This aspect of the research will be discussed in 
Chapter 6. 
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CHAPTER 4 

A PROCESS MODEL FOR COMPREHENSION AND SEMANTIC t'lBlC'RY 



4.1 General Considerations 

In the previous chapter, a conception of comprehension as attempt 
b''^ a j.istener to "infer'^ conceptual and relational information which a 
speaker is attempting to communicate, from a string of linguistic elements 
w^ich incompletely and imperfectly encode this information, was presented. 
The question to be explored in this chapter is, "By whot: sequence of 
processing operations is this feat accomplished?" A relc. d question 
emphasizes the limitations on our ability to understand discourse. It 
asks "What are the limits on the amour^ of conceptual and relational 
information which can be acquired from a discourse and retained for 
subsequent use?" and "What are the sources of such limitations on 
processing capacity and how does the processing sequence adjust to these 
limitations?" A third question, which must be asked simultaneously, is 
that of process invariance (cf. Chapter 2), viz. "To what extent is the 
.sequence of processing operations in discourse comprehension and semantic 
memory fixed or invariant over a wide range of characteristics of 
discourses, discourse contexts, temporal conditions, and other variables; 
and to what extent are these processes invariant developmentally and over 
individuals?" Given our present state of knowledge about these matters 
(see Chapters 1 and 2) and since a principal objective in developing a 
procet^s model is to provide a conceptual framework within which specific 
questions can be raised, in thic chapter we will attempt to develop a 
model which is both consistent with process models which have proven to 
be reasonably satisfactory in accounting "for other cognitive capabilities 
(e.g. memory, pattern recognition) and sufficiently general that more 
specific process models can be considered as special cases of the general 
model. 

In Chapter 1, three main components of a description of the processes 
which underlie the ability to comprehend a discourse and remember informa- 
tion acquired from a discourse were identified. The first component 
cciisists of a structural description of the discourse . ..ich is input to 
a subject. A minimal description of natural-language discourse will 
have to include a description at several levels: a description of its 
phonological characteristics; its surface structure, i.e. words plus 
syntactic ma kers and order information; its syntactic structure, i.e. 
gran.natical characteristics; and its "literal" semantic structure, ' 
i.e. the relational network which is common to and explicitly represented 
in surface sentences which are identical in^their literal meaning. Recent 
work in linguistic semantics (cf. Lakoff, 1972; Fillmore and Langendon, 
1971; Chafe, 1972) has made it increasingly clear that che levels of 
linguistic description listed above will not suffice as a complete 
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description of a textual input. "Rules of conversation," "presupposiuions," 
and the like all point to the neeA for some sort of expanded semantic 
represeivcation which includes semanL:*.'^ information which "must" be 
presupposed, as well as that which is explicitl> encoded in a text. In 
fact, the problem of semantic representation appears to be open--ended in 
the sense that it may not be possible to decide how much Information to 
include in an expanded semantic model of a discourse — expanded beyond 
the literal m^^aning of a text. 

The second main component consists of a structural representation of the 

semantic information in memory which has been acquired vhen an input 

text has been understood* The problem is to describe precisely wha t has 

been acquired. Experiments such as that of Sachs, (1967) which demonstrate 

that information concerning the form of surface expression of information 

is not retained in recognition memory for sentences, suggest that the 

problem of identifying the form in which information is represented in 

memory is related to the problem of specifying a semantic description 

of a discourse. Thus, one might adopt the research strategy of - considering 

^ semantic model developed as a description of linguistic inputs as an 

hypothetical -^--truc tural model for semantic information in memory. To the 

extent that ^ e semantic model leads to successful behavioral predictions^ 

then evidence may be a cumulated in favor of a representation in memory 

which is based on the s raantic model,. To the extent that human cognition 

is "langur.ge doninated it appears reasonable to entertain such an hypothesis. 

The third main component consists. of a sequence of processing operations 
which operate on an input discourse and which^ result in the semantic 
structural information which is represente'i in memory. While a complete 
description of these processes will have to include a detailed account 
of precisely what linguistic information is utilized aT each descriptive 
level and how that information is utilized in acquiring ^amartic infor- 
mation from discourse, quite a bit can be said about the general charac- 
teristics of the sequence of processing operations without a detailed . 
account of the processing of specific discourse characteristics. The 
existence of levels of linguistic information — phonological, syntactic, 
semantic — imply that the processor musL be capable of utilizing informa- 
tion at each level. This chapter will attempt to outline some of these 
processing ^dpabilities in a general way to provide a more detailed \ 
framework lor the research questions raised at the end of Chapter 2 an^ 
In subsequent chapter's* 

4.2 Generating Semantic Information from Discourse 

Suppose that, a spoken discourse is input to a subject and that the 
structural characteristics jpf the discourse can be specified, including 
il.3 phonological, surface, syntactic, and semantic characteristics. 
Suppose also, that we are able to monitor that information which the \ 
subject acquires as the discourse is "presented . If, In fact, that 
information has a linguistically based^ semantic form of representation,; 

— • i 

I 

J 



what capabilities must the subject have to generate this information? 
Consider first the question of what elements of the input are proc^essed. 
Limits of memory span obviously place some limits on the number of 
elements which can be processed at any one time, opening the question 
of juct what elements are selected to be processed as units. 

Identification of "units" or elements of an input discourse involves 
three ccnsidera tions : level , , type , and size (see Figure 4.1), At the 
phonological level, work on speech perception appears to have identified 
the syllable as the smallest phonological unit and- there is substantial 
evidence that larger elements may be the primary units processed (cf • 
Neisser, 1967; B ever 5 1970), Phonological eletnBnts nay also be classified 
with respect to particular phonetic features or linguistic functions. 
Note that Bever (1970) has pointed out that even at the phonological 
level, different processing strategies may lead to different phonological 
units being processed. At the level of surface structure, the iaforma- 
tional input consists of an ordered sequence of words and syntactic 
marker J which results from t^ processing of the ohonol ngicai infor .ition 
extracted from the acoustic i. put. The units which are processed can 
consist of individual words plus syntactic markers, word groups ^phrases), 
clauses, or sentences i The size of the unit processed is undoubted.!/ 
affected by syntactic atid' semantic characteristics of the input discourse 
and by other conditions which affect the processing strategies of the 
subject. Types of elemenr-^^ of the surface structure may be identified 
on the basis of their ^taCtic and semantic functions. For exanple, 
word types such as cc words, function words, parts of speech, 

animate or inanimate . a^^., and active or stative verbs may be identified; 
or, the type of element selected as a unit to-be-processed may^be based 
on further syntactic or semantic anal -sis of the sentence, e-g,, the 
agent of an action, the result of an action. 

At the syntactic level, units process ' consist of syntactically 
interpreted (classified) elements or strings of elements from the / 
surface structure which have been generated by the subject. Thus, ff 
the units in the surface structure consist of words plus syntactic / 
markers, syntactic units may consist of words or woru groups together 
with their identified role in syntax, e,g, in terms of systemic grammar, 
a noun group may be a subject, object, complement, inditate time, or be 
the possessor for another noun group (cf. Winograd, 1972), Thus, size 
of a syntactic element refers to the amount of information in the syntactic 
unit, and type refers to its classification within a grammar. Again, 
particular elements selected as units for subsequent processing may' 
reflect different processing strategies of the subject. 

At the semantic levrl, the elements which may.be the object of processing 
operations in comprehension and memory are identified in a semantic 
model such as that presented in Chapter 9. The smallect such' element 
arri^'ed at in the development df the semantic model of Chapter 9 is 
the single lexical deslf^nator ,der .^tiiig a concept or class. Since a 
concept may be thought , 2 as the intersection of a set of component 
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ELEMENTS PROCESSED 

Level s phonological structure 
' surface structure 

syntactic structure 
semani Ic structure 



Type ; surface structure: 

syntactic structure: 

semantic structure: 
Size: surface structure: 



e.g. content words, function words, 
syntactic Diarkers 

.g, verb groups, noun groups, 
preposition groups, adjective groups, 
subject, object 

constituent elements of semantic network 

words, syntactic markers, phrases, 
clauses, sentences, sentence strii 3s 



syntactic structure e.g. prepositions, preposition group, 



semantic structure: 



clause 

concerts, semantic relations, structures, 
logical relations, logical structures 



PROCESSES 



Processing. 
Levels : , 



phonetic interpreter - 
surface structure generator 
parser 

semantic interpreter 
semantic structure generator 



Constituent 
Processesf selection: 



e.g. surface, semantic, inferential 



\ 



storage , retrieval 



generative processes: e.g, encoding, generative 

reasoning, unconstrained generative 
processes 

7erif icauion: identity, derivational match , 

transfer of control 
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Figure 4.1 ' 

Classification of possible elements of a description of an input 
discourse and processes in acquisition of semantic information from a 
discourse w 



semantic :eatures or, alternatively, as a network of semantic relations 
connected to a node in memory con esponding to a lexical element, there 
certainly is an issue concerning the size of any particular concept-* 
class for a given discourse. Types of concepts may be based on 
particular semantic f'eatures, e.g. animateness, or on the basis of the 
semantic furii?tion c.^ the concept in' the discourse. The next smallest 
semantic unit is a relational triple consisting of two concepts connected 
by a single semantic relation. Types of relations may be identified 
according to the particular semantic relations designated in the 
semantic model (see Table 9'.1). Still larger units are possible: 
structures consisting of parts of the semantic network consisting of 
several concepts and the relations, connecting them; logical (conditional) 
relations consisting of tV7o propositions (semantic-.relations or semantic 
structures) connected by a conditional relation; and logical structures. 
Thus semantic elements processed as units' may also, be classified in 
terms of both type and size (or complexity) i It' should be noted that 
at each, level, a structural element is selected by the subject as a 
unit to be processed , that this selection is probably not independent 
from level to level, and that this selection may be influenced by a 
variety oi factors. Thus any further specification of precisely . what 
*'the" units are that are processed at each level will require that we 
be able to describe in detail the processing activities of the subject. 

Now consider the question of how information is utilized at each 
des'criptive level in acquiring! conceptual and relational information from 
a discourse. The fact that the structural information contained in a 
discourse can be represented at several x^vels indicates that there must' 
be corresponding levels of processing through, which information at each 
level is extracted from a discourse and utilized by the subject In 
developing a semantic model based on the, input. The problem, then, is • 
to describe tfie'^ constituent p rocesses at each level of processing 
,;and to allow for, transfer of control from one level to another, i.e. for 
processing operations at ore level to be dependent on processing opera- 
tions at another (usually ^^higher") level. -This latter characteristic 
is obviously' necessary to interpret syntactic and semantic ambiguities, 
pronominal reference* and the like. Transfer of control may also -be . . 
involved in, for example, the routine selection of a unit of a surface > 
sequence on the basis of its semantic function. A list of processing 
levels and constituent processes is found in Figure 4.1 and a flow chart 
representation of the general organization of' the levels of processing' 
in generating semantic information from discourse is given in Figure 4:. 2. 
The ^enn.c.T^co of processing operations which we suppose occurs' in generating 
sem ^formation from linguistic inputs consists roughly of the 

fol... j^ng sequence of operations: (1) generating a surface structure- 
from sensory inputs, (2) syntactic analysis, (3) semantic interpretation 
(including recognition of lexical elements and semantic interpretation 
of syntactic relations) , and (4) generative operations on retrieved 
semantic information and on semantic information resulting from the 
in' irpretation of the input. Selection and verification (matching) 
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processes are supposed to operate as a part of each of these operations, 
and information storage can occur at any point in the sequence. Thus, 
the surface sentence -'He moved the new car from the road to the garage" 
(1) is generated from acoustic inputs; (2) certain syntactic relations 
are identified (e.g. surface sub'ject, verb, surface object , prepositional 
phrases) and input to the* semantic interpreter together with the surface 
sentence; (3) lexical labels in long te-rm memory corresponding to lexical 
elements in the input are retrieved from long term memory, ^tched to 
input elements, and used together with the syntactic information -to^ 
generate a proposition (semantic representation)-'-; (4) additional 
semantic information structurally related to the proposition may be 
retrieved as a part of additional processing opera-tions ou the semantic 
information- [e.g. as in identifying the .pronoun ''he" as "John" (say) on 
the basis of context]. For a discourse '^(rather than a single isolated 
sentence), a substantial gjriount of processing of the sort indicated' by ■ 
stages *(4) and* (5) would be expected to occur. We would also expect 
very little information resulting from stages (1) and (2) to ba stored 
in long term memory. 

According to this model, e^t each level of processing, a sequence of 
processing events occurs which may invoLye a number of constituent 
operations: (1)^ s election : any operations which segment or restrict that 
information which is to be processed; (2) storaf^e : maintenance of 
information both in^ a limited capacity short term memory buff ei: and on 
a long terra basis;. (3) retrieval of information from short or long term 
memory: (4) operations which genetate. surf ace or semantic information 
from informatlOiial inputs and from Information retrieved from long term 
memory; (5) verification (matching) operations which match generated 
elements against preyfousl-y generated elements, and (£) control processes 
which transfer contrO'I from one level of processing to another. Thus, the 
surface sentence '*He moved the car from the ro^d to the garage" maybe 
generated by segmenting the phonetic sequence into word« (plus syntactic 
markers), storing the segmented sequence in a rehearsal .buffer , retrieving' 
the lexical elements and syntactic markers from memory, matching the 
retrieved lexical elements and syntactic 'ti-arkers against stored phonetic * 
segments, and then transferlng control to the , syntactic and semantic 
components of the system. In Figure 4.2, the solid arrows^ Represent , 
information flow; the dotted arrows indicate that 'control can'be transferred 
from one component -to another. Thus each level of processing can be 
thought of as a component of the next *level in the sequence. Figure 
4.3 summarizes the processing evetits-that are supposed to occur at the 
semantic level as a discourse is presented. (Possible '''semantic" contr 
of the parser is ignored in the Figure and in the discussion which 
follows.) As the phonetic sequence is received, ''input" processes resul 
in a syntactically interpreted string of * words and .syntactic markers 
which .is held in a memory buffer (working memibry)'. A subset of this 
symbolic string may then be selected for further (semantic) processing 
Such selection proccsi?es may_ b.e under'* the control of surface and syntactjic 
features of the passage, but ^idg^ltive controls of selection (selection 
strategies) based on semantic features' are also possible. For example, 
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in generating semantic information from discourse 
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Figure A. 3 

Some constituent processing operations in discourse comprehension 
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semantic features might be expected to become increasingly important 
in influencing the selection of information frxm the input as the " 
subject proceeds through a long passage and builds his own ^'semantic 
model'' of the passage. In the. present model, a distinction is made 
between three types of selection i;rocesses (see Figure 4.1)-. This 
distinction is based on whether or not selection is based on surface 
(incl, synt^,ctic) features of the discourse, semantic features, or is the 
result of evaluative operations on the semantic content of the essay 
(as, for example, when an "idea" is selected because of its relations 
to other "ideas" in the passage). Selection which is based on such 
evaluative judgment, and which represents a "decision-to-procesc^'* 
resulting from (possibly complex) cognitive operations on the content 
of the passage, will be referred to as inferential selection ; selection 
which' I's not based on such inferential evaluation but rather on surface . 
or semantic features of the text will be referred to either as surface 
selection or semantic selection respectively* Surface selection would 
result if, for example, a listener selected elements in response to 
such surface- characteristics of a text as inflectional emphasis of a 
speaker, features of syntax, or sequential or temporal features of the 
text. In most instances surface, seiiiantic, and inferential selection 
processes probably operate in complement to one another • For example, 
a paragraph structure may influence selection of the topic sentence, 
while at the same time, inferences based on the content of the paragraph 
may influence selection of the ideas represented in the topic sentence 
as central to an understanding of the paragraph. 

As the processing sequence proceeds, once an element of the input is 
selected, then the element is enco d?^ Cseir.antica] 1-^ terprete . ; 
through the generation of a sema- ^ mer" cor ' j : - ir:;, to e 
selected el tn: it. S ^ener^: r. ^ :ic ef :i ed zz 

interpre -pcess The ^en . ..:n ^ jecu < lement 

necessar.^. .olves rcrieval or s , c c .emer. .. n lo.^g tc rai 

memory. Since some constraints mus .vern what is , ^nerated, ±z is 
supposed next that a generated semancie element must be. verified in 
some way against the selected input element. Processes associated with 
evaluating the correspondence, between a generated element of the 
semantic model and a selected element of the input string will be called 
verification processes . The simplest sort of verification (which wol.;.^ 
be expected to occur at the beginning of a passage) is that of an identity 
match, i.e., verification that the semantic element. may be expressed 
by the corresponding element of the stored surface structure. Following 
verification (and depending on time constraints), the element of the 
semantic model may be operated upon and transformed, the result of 
the transformation verified, et cetera . Resulting semantic elements 
are stored in long term memory. 

As this processing sequence recycles with the input of successive 
elements of the input string, the nature of selection, generative 
processes, verification, and operations on semantic elements might be 
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expected to change as semantic elements are generated which were not 
explicitly present in the input text. The stages of such processing 
involving operations on the semantic content are outlined in the lower 
half of Figure 4.3. Thus, in addition to verification based on an 
identity match, verification based on structural features of the stored 
"semantic model" becomes theoretically possible as the ''model" develops 
a well formed structure. Thus, operations on the stored semantic model 
wou^d be expected to occur resulting in the generation of structural 
elements not corresponding to explicitly presented elements. Verifica- 
tion of these elements, then, must involve criteria other than that of 
an identity match. Possibilities include verification of class corres- 
pondence in which the generated concept includes or is included in 
the input concept; verification of implication in which the generated 
concept implies or is implied by previously generated semantic structures 
(or both); and verification of noncontradiction in which the generated 
concept does not contradict previously generated structures . As was 
indicated in Chapter 3, these categories of verification correspond 
clocely to judgments that must be made in scoring subjects' protocols; 
An identification of categories of generative processes can be made 
which is based on possible types of verification involving the generated 
concept. Thus in addition to encoding "(generation of identities or 
imperfectly discriminated elements) , one can identify pxroces^ses of 
generative inf erence (generation of inferences or elements whic^h ^jnply 
and/or are implied by previously generated structures s and of e,, .boratic i 
(generation of elements T.^dch, while they are not inferential! a- ivable 
from the previously generated structure, do not contraiict tha ::rLCture . 
Elaboration probably includes the generation of semant. c eleme:- . v;hich 
are often categorized as linguistic presuppositions. T Inally, -rra- 
dictory elatorative elements may be generated if no- ve: ificatic lakes 
place or if -he verification is faulty. Such elements iiay also 
considered to be transiormations of inf erentially derivable eleiu^nts 
and thus their interpretation may be ambiguous. A great many operations 
on semantic Information may be identified. In fact> these operations 
represent the entire set of possible cognitive operations on any element 
of semantic content. 

4.3 Generating Discourse from Semantic Information 

Having developed the outlines of a model describing the processes 

involved in acquiring semantic information from naturals-language 
discourse, how might the processes involved in verbally reconstructing 
this information be described? While such a description is an Interesting 
problem- in its own right, it is also necessary to specify the processes 
involved in verbally reconstructing acquired semantic information in 
order to Identify possible ambiguities in the interpretation of classes 
of responses obtained from the recall (meaning reconstruction) task as 
resulting from particular processing operations during acquisition . 

Verbal reconstruction of (previously acquired) semantic information 
involves processing the same elements as those identified in Figure 4.1; 
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it also involves similar levtils of processing and many of the same 
constituent processes. The processing levels most likely to be 
involved in speech production involve (1) the generation of semantic 
structures, (2) the generation of surface expressions by the application 

rules of expression to generate surface sentences which express a 
semantic structure, and (3) articulatory or lexicographic processes, 
which result in , either a spoken or written output sequence. The sequence 
of processing operations which we suppose occurs in verbally recon- 
structing acquired knowledge is as follows. A directed search of 
stored semantic information in long term memory (including possible 
operations ^n retrieved semantic information, e.g. inferential search) 
results ir the retrieval of a semantic structure consisting of conceptual 
and relational information, which is held in a short term memory buffer. 
Then an element is selected from the semantic structure held in the 
buffer, the selected element is possibly operated on, and rules of 
expression are applied to generate a grammatical string of words and 
syntactic marktnrs-. The^ surface expression , may be verified and finally 
output by means of articulatory or lexicographic Torocesses. 

The meaning reconstruction task clearly invoii b 'th sequences of 
processing operations — those which occur during input as semantic 
inrormation is acquired, and those which occur dur:,ng output when tr. is 
information is retrieved and expressed linguistically. In Chapter 3 
various classes of responses were identified whicn are obtained from 
suhects' verbal reconstructions of knowledge acquired from a discour. i 
(Fi;::ure 3.13). These response classes were identified with particular 
processing operations. Since similar processes can occur :. • i n durin:: 
iirr. as a ~~manz...z r:L:T:resent£ :ior of :. discours-- built up in ~:emc r 
and : jring ::itpuL a .. .^nantic .nformat_ n is retrievec. or generati^d 
fro: retri: -ed informauion ana expressed linguistically, a response in 
a particular class may be indicative of particular processing operations 
occurring either during input, during output, or both. Thus, for example, 
if subject-generated inferred semantic relations are observed in a subject's 
recall protocol, they may have been generated at input as the discourse 
was presented J or they may be the result of inferential processes which 
occurred during output as semantic information acquired during input 
was reconstructed. This ambiguity with regard to whether a given response 
is the result of a process or processes occurring at input or at output 
is encountered in any learning task ^ in which the recall method is used 
to assess learning. In Chapter 6 we will investigate this question with 
particular reference to the occurrence or nonoccurrence of generative 
processes (inferential and elaborative) during input . Clearly, if 
comprehension involves "an attempt by a listener to 'infer' conceptual 
and relational information which a speaker is attempting to communicate,, 
from a string of linguistic elements which incompletely and imperfectly 
encode this intormation, " then generative processes must occur at input — 
as semantic information is being acquired. 
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CHAPTER 5 

EFFECTS OF CONTEXT-lriDUCED COGNITIVE OPERATIONS 
5-1 Introduction 

In the previous chapters a conception of discourse comprehension as 
involving three main components — a, structural model of a discourse 
presented to a subject, a structural model of that information which is 
acquired from an input discourse, and an account of the sequence of 
processing ope.rations which result in the acquired information was 
developed; one semantic structural model and a procedure for scoring 
semantic information contained in a subject's verbal reconstruction of 
knowledge acquired from a discourse which is based on the semantic model 
were described; and a research strategy involving inferring characteristi 
of the sequence of processing operations in comprehension 
memory from observations of specific sorts of semantic i. 
subject's recall protc • jIe a.d observaticis of the effeCi 
contextual condit jhs n acqi. Ired elemei.tt of semantic ir 
pr. . ented. Eleme: ts oi serrar/ L;: information, it was seer 
typ- and size (or compl-xity. I. . Figure I4.I) and semant: 
a SI. -ject's protoc:)! may be t:. :er reconstructions of ele. 
exp: cit y coded in a present , discourse or self-genera^, 
.gene-atec elements in princip. ^lay )e classified on th-. 
specific GOgni- :Ye operEtio::: -^ch resulted ir. those e,.. 
repr^-jducei eler rnts may oe re--: :ent- i in subjerts* r-c 
formel o • alte/ed romi. It r-r^r.-: - show prec sel" 
cies of -esro: ;e ^'lasse sur r n-r (cf. Figire 3. 

specific yvr o-:-ie' : abc. irf-; aat.i:, processing opeir.. . .3 m comprehension 
and sema -:i • , T..,.. develorjienu of such .a "set of hypotheses also 

will inQi.cate addition?.! reasons why the processing of discoixrse should 
be different from the processing of single sentences. 

The present chapter will develop a set of hypotheses which are concerned 
with those processes which are involved at the semantic level in normal 
comprehension and with the manner in which those processes change with 
repeated exposures to a discourse and in different discourse contexts. 
A principal question underlying many of these hypotheses concerns whether 
our basic conception of the language comprehender should be that of a 
primarily interpretive system (which can operate generatively when required 
to do so by the constraints of a particular discourse or discourse context), 
or that of a generative system (such as that described in Chapter I4). The 
chapter will then present the principal experimental results which pertain 
to these hypotheses: results concerning mean response^ class frequencies.. 
Two other„ sources of empirical information concerning noi-mal processes in 
discourse comprehension and concerning process,, invar iance will be discussed 
in later chapters: response class intercorrelations computed with different 
degrees of exposure to. the text, and correlations of these response measures 
with measures of subjects' performance levels on a set of narrowly defined 
ability tests. Hypotheses concerning the dependence structures of response 
measures which involve questions of process independence and alternative 
sources of observed stochastic, growt.h, and hypotheses concerning sources 
of individual -differences in semantic infonnation acquired will be offered 
after the principal experimental results have been exajnined. 
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Subjects . One hundred forty-one undergraduates from Calift)rnia State 
College at Hayvard, who were paid for their services, served as subjects. 
Most of the students were enrolled in introductory psychology courses. 
Sixty-six subjects were male; seventy-five were female. 

Material . A 503 word essay was constructed from th-^.t used by Dawes (1966. 
consisting of 30 independent clauses - - d 25 depend- ^ clauses. The 
passage r^onsistei entirel;;, of declarer sentence: there were 
fi'.'e r-^... e transformations and two n :atives. Nr ^ntences were anbir';.: 
The c:;r:r .-:ze text of t::e passage may found in At ;, .dix A. The pacsar ■ 
was a:..: ■; i according ".-o the procedv - ■ for se:^,an^ analysis prosentec 
in- ?ha: ■. into the 1 itional stru re pres- it-^ : Figures 5.1 to 

3.8. 7: tractural presentation v:\r taken a;3 l:. :3ase seina: Ac 
(pr^ posi al) r-:ructi;i :: f c r the essa " 

A n"Tni:er ■ ' rob_ w: th'.3 and otr. — method.: y\ —riT.ic ai: "3is : 
alre':i~'' . . lie:; le 'xn ^>iditional ;:ajor pr^ an"' r. d ' 

t - ■ 'ule,^ -xistr- fo; con"^^er- ::r i-tc 

IT: ■ - . ' ■_■ . ^i" : a detai "d l:.n;- . /-based . :ar. 

m: al . 0 tL.. of C apte 9)5 ti. _s pi ol ^em , still seems 

V :r : ::ri s ion. A solution to the problem would require not only 

a ^emc..u,. . odel, but also a surface grajnmar and a set of rules of 
expression mapping from a semantic structure to its surface expressions. 
The present procedures for generating a semantic representation appeal 
to linguistic intuitions concerning the set of surface expressions which ' 
■ are considered to be paraphrases. Nevertheless, a semantic model of 
any text can be defined to represent the text and used as a template 
against which subject's protocols are scored even though there may be 
an element of arbitrariness in the representation. 

A high quality tape recording of the passage was made using an Ampex 
861 tape recorder and a Schure Model 5^5 microphone (7 1/2 i.p.s.). The 
passage was read at a moderate rate by an experienced male reader; read- 
ing, time a\ raged about 3 minutes. 

Design .- Subjects were randoirly assigned to three exper^imental groups 
' consisting of U7, U9, and U5 subjects. The first group' (A) consisted of 
18 males and 29 females ; group B nad 26 males and 23 females , ajid group 
C had- 22 males and 23 females. The three experimental groups correspond 
to the three experimental conditions described in Chapter 2. In each 
condition, subjects were repeatedly presented the five hiondred word 
, „ essay entitled Circle Island . 

In the first experimental condition (a) , subjects were told that the 
material which they would hear would consist of a passage which describes 
a socio-political problem on an hypothetical island, involving a canal, 
a threatened civil war, and the probable collapse of the island^s 
economy, and were instructed., only that they were to recount in writing 
what they had heard. They were also told that they were not expected to 
^ ' ' reproduce the passage verbatim. In the second condition CB), subjects 

were told that they were participating in an experiment concerned both 



with investigating the aoility of individuals to remember spoken material 
and to use this information' to solve problems^ presented vith a problem 
involving the content of the essay (but giving no addil ,onal inforifKit ion) , 
and presented with instructions designed "to direct' ther. to think ahou^ 
how to solve the problem while they try to remember irfcrmation from 
the essay. The problem involved having the subject ge:-ierate as many 
alternate solutions as he could for the island's problems, using the 
information given in the essay concerning -^he island^ s social, economic, 
and political situation. The problem was -desigr^ed to cause the subject 
to operate inf erent ially on a lar/?:e number of the semantic relations 
conveyed in the structure of the passage.- ' Since the "level of difficulty" 
of the passap;e was about that of a somewhat involved newspaper story, it 
was felt that if this context produced predictable effects on processes 
in comprehension and memory, the result would be likely to be generaliz- 
able to typical situations involvinr verbal ( - muni cat * ^.nd would 
certainly generalize to intel ec^ : • - comp?' 'ori tasks. 

In the third condition, condition (C;, subjects worked only on developing 
solutions to the problem involving the island. However, after three trials 
of exposure to the text and work on solutions, on the fourth trial these 
subjects were asked to recount the essay in writing. Subjects in condition; 
A and B recciinted the story four times , once after each exposure to the 
text. After the fourth trial, all subjects were presented with the 
problem solving task. Thus condition A involved "incidental problem 
solving" and condition C involved "inciden-^* 1 memory". The temporal 
course of events over the four trials and subsequent problem solving 
were kept precisely equivalent for the three conditions. In all three 
conditions , exactly the same prior information about the content of the 
passage was contained in the instructions-. 

All subjects returned one week after the first session to take a battery 
of ability tests, and we're, asked at that time (before administration of 
the tests) to recount in wr'^ing their best recollection of the passage. 
Subjects were tested in groups varying between ten and fifteen persons 
in two three-^hour sessions held one week apart. Two experimenters were 
used; approximately half of the subjects in each group were tested by 
each experimenter.. Subjects were instructed not to talk about the 
experiment. The first session consisted of the learning and problem 
solving tasks, a test of set relations, and the administration of a 
strategy assessment questionnaire; the second session consisted of one 
(unexpected) written recall followed by the admihist rat ion of a battery 
of ability tests . 

Procedure . Subjects in groups A and B were read the following instructions: 

In this session we are in effect trying to simulate part of a classroom 
situation. The material on the tape which you will hear is artificial 
since we had to moke sure that it was equally unfajniliar to everyone. It 
is also. much shorter than a typical lecture, but listen to It as if it 
were being given by a lecturer. However, do not take notes. 

(Demonstrate) Begin by removing the first booklet from the envelope. 

Read the instructions along with me as I read them out loud, (Read 
instructions and answer any questions). 



Instructions, roup A : 

1. You , are participating in an experiment which is concerned 
vith investigating the ability of individuals to reinainber 
spoken material. The material vill consist of a passage 
which describes a socio-political problem on a hypothetical 
island, involving a canal, a threatened civil war, and the 
probable collapse of the island economy, 

^2. V.^en the experimenter starts the tape recorder, you will 
hear the first presentation of the passage. Your task is 
going to be to recoiont in writing what you have heard. In 
accomplishing this, you must not take notes but rely only on 
your memcry. After the passage has been played, you will be 
given time to write your best recollection. You are not 
expected to reproduce the passage word-for-word. Please use 
a prose style (complete sentences) as often as you can. 

3. You will be given I5 minutes for writing. The experimenter 
will tell you when to begin and when to stop. The a:nount of 
- time allotted for writing will be more than sufficient for some 
of you. Should you finish before the experimenter gives the 
signal to stop, remain in your seat and wait for the next 
presentation. 

Since we are interested in how your memory changes with 
additional opportunities" to hear the material, we will repeat 
> this procedure k times. Before each new presentation of 

the passage and while you are writing, you should not look back 
at what you have written for previous presentat ions. Nor 
^should you turn the pages an^ read ahead in your instructions 
booklet until told to do so by the experimenter. 

Inst ructions, Group £ : 

1. You are participating in ari experiment concerned with 

investigating the ability of individuals to remember spoken 
material and use this information to solve problems. You may 
think of this experiment as a„ study of how you are able to 
Tfemember and use information which you hear in a class lecture, 
when the lecturer states a problem in advance and then asks 
you to. think about this problem as he. presents the facts and 
id^as pertaining to it. In the experiment which follows, you 
will hear a- short "lecture'' which describes a socio-political 
problem on a hypothetical island, involving a canal, a 
threatened civil war, and the probable collapse of the island's 
economy. Some of you may typically think a lot about problem 
solutions as you hear such a. lecture, while others may only 
concentrate on taking in the facts. We would like all^ of you 
to think about problem solutions as you try to "take in" the 
facts. Thus, we would like you to both remember the facts ■ 
and ideas presented, as well as use them in understanding and 
*t3:'ying_to resolve the problem. 
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2. Although our experiir^ent is desr.gned to "simulate'' a class-room 
situation, ve vcjit to avoid sta,ting the problem in a formal 
vay — ^ we don*t want it to reseinble an exam Q.uestion. There- 
fore, to make your task more interesting, and to involve you 
in a meaningful and imaginative approach to problem solving, 
ve vould like for you to take the role of a person directly* 
affected by the facts and events on the island. Imagine that 
you live in a country that is dependent on this island for 
certain exports. The imminent collapse of the island's 
economy' poses a grave threat to your country. Further, imagine 
that you are an intelligence agent for your government and 

you have bv^en given the follovinp: a3sip;nment: 

Familiarize yourself with the situation on the island, then 
come up vith as many alternative plans as you can which will: 

1. Prevent a civil war. 

2. Get a canal built without penalizing any' particular 
group. 

(Note: You may use any and all methods tq achieve these 
goals except those which necessitate military intervention 
or which change the island's present form of government.) 

3. Your problem is thus twofold. It is first to remember as much 
as possible about the situation on the island, while at the 
same time develop a set of alternative solutions to the problem . 
The experiment will be divided into two parts. In the first 
part, the passage containing information about the island 

will be presented. While you should be thinking: about how to 
accomplish your assignment as an intelligence a^^ent , your 
primary task during this part will be to remember as much 
information about the island as you can. After the passage 
is read, you will be asked to recount in vriting what you have 
heard. In accomplishing this, you must not take notes but 
■rely only on your memory. After the passapie has been played, 
you will be given time to write your best recollection. You 
are not expected to reproduce the passage word-for-word. Please 
use a prose style (complete sentences) as often as you can. 
[Paragraph 3 of the instructions given group A follows.] 

k. The second part of the experiment will involve your describing 
and working out in writing your solutions to the island's 
. problems. The experimenter will tell you when to begin the 
second part of the experiment. ^. ~ 

(Demonstrate) Now turn to the next page. It should be a clean sheet 
of lined paper. Write the number 1 in the top margin (demonstrate). 
I will now start the tape recorder and play the first presentation. 
(Play trial l) • 

I would- now like you to write down as much as you can remember of 
what you've just heard. You are not expected .to do this word-^for- 
word. You m*ay use your own words but please use complete sentences 
and write legibly. You will have a maximum of 15 minutes to 
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accoiTiplish this. Read;^^ GOI (start vatch) CHepeat instructions 

5 and .6 for trials 2 and 3) 

7- STOPI (stop vatch) Please turn to the next clean sheet of paper 
and write a H in the top margin, I will now repla}^ the passage 
for the final time. (Play tape) 

8. Since this is your final trial, 1 would like to review the instructions 
again briefly to be sure that yo^i understand your task. For trial 

we would again like you to recount in writing, as accurately 
as possible, the passage which you- have heard. You are not expected 
to reproduce^ the passage vord-f or-word. Use a prose style (complete 
sentences) as often as you can. 

You will be given 15 minutes for writing your best recollection of 
the passage. The amount of time allotted for writing will be more 
than sufficient for some of you. Should you finish before the 
experimenter gives the signal to stop, remain in your seat and 
■wait for the experimenter's instructions. Do not look back at what 
you have written for previous presentations. Do not turn pages 
in the booklet until told to do so by the experimenter. Ready — GOI 

9. STOP I Cstop watch) (Demonstrate) Now turn the pages in the booklet 
until you arrive at the next dittoed page of instructions. Read 
the instructions as I yead them outloud. (Read instructions and 
answer questions) 

Instructions, Group A : , 

Now that you are thoroughly familiar with the situation on 
the island, we want to see how you can put this information 
to use. Your next task will be to work out solutions to the 
island* s problems. We would like you to approach this task 
as fpllows : . 

Imagine that you live in a country that is dependent on this 
island for certain exports, ' -Ihe immix. it collapse of the 
island's economy poses a grave threat to your counti'y. Your 
role is that of an intelligence agent for your government 
who has been given the' following assignment: 

Come up with as many alternative plans as you can which will;- 

1. Prevent a civil war- 

2. Get the canal built without penalizing any particular group. 

(Note: You may use any and all methods to achieve these 
goals except those which necessitajte military intervention 
or which change the island's pre'sent form of government.) 

In doing this you must not look back at what you have written, 
but rely only on your memory. ; 

Assume that these plans r-'ll be presented to your country's 
Committee on Foreign Policy, and that some members of this 
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conijiiittee are not famili?.r vi\h the ""island or what has 
transpired there* Itierefore, write j'^cur plans on the follow- 
ing pages in a clear, concise manner so that the committee 
members can easily Understand what you have in ipind. Do this 
by using the facts you remember about the island and the. 
situation there to specify how and, why each plan will change 
■ this situation sc as to fulfill the assignme nt . 

Here is an example, of a very poor plan: 

1. Have cur aiiforce bomb them back into the stone a^^e. 

Although this plan^raight prevent a civil war, it obviously 
does not fulfill the assignment. It does not take the reality 
of the situation into account, 'nor does it give the facts 
explaining how and why this plan Would fulfill the assignment. 
It also violates the restrict ion from military intervention. 
Avoid plans of such an i.-nrealistic and incomplete nature. 

Number your plans, , and separate them so that it will.be clear 
from your writing where^ one plan ends and the next one begins. 

Remember that this problem is' open-*ended, i.e., it has no 
single correct solution. We are interested in your ability 
to come up" with many well-formulated and documented p!^ans. 

Instructions, Group B: - ' 

iicw that you V have completed part one of the experiment and 
are thoroughly familiar with the situation on the island, we 
want to see ho'w^you have put this information to use, ' There- 
f oi4 , your next task is going to be to write out your solutions 
to the island's problems* Remember, we asked you to imagine- 
that you live in a country that is d pendent on this island 
for certain exports. [The remainder of the instructions vbre 
identical to those read to group A. ] ' ^ 

The subjects then worked for thirty jiiinutes writing down their solutions 
to the problem. - 

Subjects in group C read the following instructions. [The preceding 
instructions read to the s--^hjects were identical to those' read to the 
subjects in groups A and B.J 

You are participating in an experiment concerning the ability 
of individuals to solve problems based on extensive factual, 
material, aurally presented. In the experiment which follows, 
you will hear a short "lecture^^ which describes a socio-politic 
problera on a hyp9thetical island, involving a canal, a 
threatened civil war, and the probable collarpse of the Island* s 
economy. You may think of this experiment^ as a study of how 
you are able to use information which you hear in* a class 
lecture, when the lecturer states a problem in advance and then 
asks you to think about this problem as .-he presents the facts 
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and ideas pertaining to it. [Paragraph 2 given in the instruc- 
tions to group B then followed, and that was followed by 
paragraph 12 in the instructions to gi '^up A."' 

When the experimenter starts the tape : 
carefully to the passage. Do not take 

presentation. When the presentation iS; ^'ill be • 

given 15 minutes to work on developing alternative plans of 
action. Since we are interested in. how problem solutions 
change with- additional opportunities to hear the material,, 
we will repeat this procedure k times. Before each new ■ 
presentation of the passage and while you are writing your 
plans 5 you should not look back at what you have written for ^ 
previous presentations. Nor should you turn the pages and read 
aJhead in your instructions booklet' until told to do so by the 
experimenter. 

Now turn to the next page. It should be a clean sheet of lined paper. 
Write the number 1 in the top margin (demonstrate). I will now s.tart 
the tape and play the first presentation. (Play trial 1.) 

I would now like you to write down as many alternative plajie as you 
can. You may tear out the instructions sheet along the dotted line so 
that you may refer to them as you write. Be sure to describe each 
solution plan completely. You will have a total of 15 minutes in 
which to do this. Continue trying to construct alt^ernative plans until 
time is called. Ready GO'. (start watch) 

STOP I (stop watch) Now turn to the next' blank sheet of paper and 
write the number 2 in the top margin. I will now replay the passage. 
(Play trial 2). 

Again, write down as many alternative plans as you can. You shoul^d 
enlarge upon the plans you wrote on the previous trial, and think of 
as many new plans as you can. Do not look back at what you wrote for 

the previous trial. You will have a maximum of 15 minutes. Ready . 

GOI (start watch)' (Repeat last two instructions' for trial 3. ) 

STOP! (stop-watch) Please turn to the next clean sheet of paper and 
write a ii in the top margin. I will now replay the passage for the 
final time (Play trial k) 

Before writing your plans for^the final time, please turn the pages 
in the booklet until you arrive at the next dittoed page of instructions 
(demonstrate) Read the instructions as I read them aloud. (Read memory 
instructions and answer any questions) 

Memory Instructions , Group C: 

Now, before you write out your final plans, we would like you 
to recount in writing, as accurately as possible, the p.agsage 
which you have heard. You are not expected to reproduc^Htjre.. 
passage word-for-word. Use- a prose style (complete sentences) 
as often as you can. 
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You will be given 15 minutes for writing your best recollection 
of the passage. The experimenter will tell you when to begin 
and when to stop- The amount of time allotted for writing 
will be more than sufficient for sone of you. Should you 
finish before the experimenter gives the signal tc stop, ^emain 
in your seat and wait for the experimenter^ s instruction, 
to go on with your final solution plans. 

Do not look back at what you have written for previous 
presentations. Do not turn pages in the booklet until told 
to do so by the ex^^^erimenter . 

In this final trial, you will be given a longer time to enlarge upon 
previously developed plans and to construct . new 'plans . To be sure that 
the problem and its constraints are fresh in your mind, we will quickly 
review the instructions. {The remainder .of the instructions were 
identical to those read to groups A ^d B.] 

Ability measures . AJLl subjects took the following ability texts selected 
from the Kit of Reference Tests for Cognitive Abilities of French, 
Ekstrom;, and Price (1963) : (l) Hidden Patterns CCF-2), (2) Word 
Arrangement (Fe-B), (3) Inference (Rs-3), (k) Auditory Letter Span 
(Ms-3), (5)- First and Last Names (Ma-3), (6) Theme (Fi^2), (7) .Object 
Naming (Xs-3), (8) Gestault Completion (Cs-l), (9) Controlled 
Associations (Fa-l), (10) Letter Sets (l-l), (ll) Topics (Fi-l) , 
(12) Advanced Vocabulary (V-^l+), (13) Simile Interpretations (Fe-2), 
ilk) Associations IV (Fa^3), and (I5) Four-letter Words (Cs«3). Abilities 
data will be considered in Chapter 7- . 

Strategy measures . In an attempt to reliably assess the extent to 
which s.ubjects adopted specific strategies in acquiring, semantic 
information from a discourse, judgments were obtained concerning 
strategies employed in remembering the content of the essay. The 
judgements were " obtained after subjects had written their solutions 
to the problem and using, a method of assessment developed for use in 
list learning tasks (Frederiksen , I969), by asking the subjects first 
to study a list of statements of m.ethods ' or strategies which they may 
have employed in remembering the content of the essay, presenting them 
with a series of pagjs containing the list of statements with randomly 
selected propositions appearing at the top of each page , and requiring 
them to check any methods which described how they remembered the idea 
at the top of the page. A score for each strategy was obtained by 
summing the number of propositions for which the strategy was checked. 
A sample proposition and the list . of strategy statements follows: 

IDEA: The actual governing body is a ten man senate, called the 
Federal Assembly. 

!• No particular strategy . I did not use any particular strategy 

in trying to remember this idea. 

^■•^.- \Key words by rote . I tried to learn key words, related to this 
i'deaj.by rote, using these key words in reconstructing the idea. 
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3. Particular ideas . I tried to concentrate on remembering parti- 
cular ideas and events and for this reason concentrated on 
this idea. ' 

Central ideas - In remembering this idea, I focused on trying 
to discover and remembe'r the ^ tral ideas of the passage, 
•then related this idea to t^' central ideas. 

5. Details. I tried to riptive details from the 

expression of this idea ii. assage, 

_ 6. Ideas in seqy.ence . In remembering this idea, I concentrated 
on recounting the idea in the sequence in vhich it occurred 
in the passage. 

7- Ordered in my ovn vay . In remembering this idea, I did 

not pay particular attention to its position in the sequence 
of ideas but rather ordered it in my ovn vay. ■ 

8. Most important ideas first . I considered some ideas to be 
more important than others, and in remembering this idea I . 
considered its importance within the passage. 

_ 9.- Unstated relationships . In remembering this idea, I tried 
to think pf nev connections or relationships betveen this 
idea and others in the passage — relationships vhich were 
not explicitly stated in the passage. 

10. Unusual ideas . I found this idea to be -somewhat unusual and 
took particular note of it since it was an idea which was 
strange, peculiar, ^or unexpected. 

11. Shifted, attention . I frequently shifted iny attention from 
this idea to other ideas in the passage. 

12. Visual images > I. tried to form visual images suggested by 
this idea, using these images to help remember the idea. . 

13. Shifted strategies . I frequently shifted my strategies or 
approaches, to the problem of remembering this idea. 

1^. Attention to parts . I did not pay attention to the part of 
the passage expressing this idea every time it was presented, 
ignoring it in order to concentrate on other parts of the 
passage. . ' 

15. Formed^ assocj^atlons . ' I tried to form associations' to the 
part of the pa^ssage expressing this idea md later -used 
these associations in remembering the idea. 

Classification . I tried to organize or classify ideas within 
the passage, using this classification in remembering this 
idea. , ■' 
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17. Previous knowledge . I tried to relate this idea to my 
previous knowledge or conceptions related to the subject 
under discussion. 

18. Illustrations . I tried to think of illustrations ■ or metaphors 
for this idea. 

19. Systematic method . I tr' ' to utilize a systeraati ■ rational 
procedure, ±.n ' ^n" that I followed in remembering 
this idea. 

20- Noticed effectiveness . If ray initial strategy did not seem 
effective for remembering this idea, I tried a new strategy. 

21. Rote memory . I remembered this idea by - learning by rote 
the phrase, that I heard expressing the idea. 

22. Elaboration . I found that this idea suggested additional 
id^as to me which helped me remember the original idea. 

23. Expository ordering of ideas . In remembering this idea, I 
ordered it in the sequence of ideas in such a w-ay to 
facilitate writing an essay which someone could easily under- 
stand. ' 

, • ■ '-'^ 
2U.. ANY OTHER METHOD USED: 



The sentences used were: (l)" "A large canal would upset the island's 
ecological balance", (2) "Circle Island has few rivers and hence a 
shortage of water", (3) "Beef is the only export of the island", (k) 
"The island is run democratically", (5) "The senate's job is to carry 
out the will of the- maj ority" , (6) "The main opposition to the canal 
idea came from the ranchers", (7) "The senate decided that it would 
be too ecologically dangerous to have a canal that was more than two 
feet ^^wide and one foot deep", (8) "The ' farms of the island are small" , 
(9) "The ranchers are much more prosperous than the farmers", (lO) "An 
island scientist, Dr. Carl Oliver, discovered a cheap method of 
converting salt water into fresh water." Strategies data will be 
considered in. Chapter 7. 

Response measures . Semantic response measures were obtained by applying 
the scoring procedures described in Chapter 3 and consist of the rela- 
tive frequencies- of responses in each subject's protocol in each of the 
classes listed in Figure '3.13. Each semantic, measure was obtained for • 
each trial. A number of surface linguistic counts were also obtained by 
means of a computei- program written for the purpose including certain 
simple linguistic, counts: number of letters, words, independent clauses-, 
dependent clauses, coiints of parts of speech, articles, adjectives, 
pronouns, noims , adverbs, verbs, prepositions, conjunctions, causal 
conjunctions- and counts of number of passive, negative, and passive + 
hegatlve transformations. 
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3 * ? Hypotheses 

The basic measures resulting ^his experiment consist of the set 

of scores obtained from matchii.,.: ^ subject's recall protocol to the 
semantic model of the. passage Circle Island (using the scoring 
procedures described in Chapter 3) ; a response pattern consisting of 
a set of counts of the number of semantic elements present in a subject^s 
protocol in each of thirteen response classes CFigure 3.13). Two types 
of semantic elements will be considered: conc^^^ s and relations. 
\fhile more response categories are possibl^^ id counts could be obtained 
separately for different types of relation. , parts of a passage, etc*, 
if too maxiy response, classes are used, the resulting frequencies of 
responses in each class become too small to be useful. For groups A 
and B, these respo-.xse measures are obtained on each of four trials 
amd on a fifth reminiscence trial; for group C, the measures are - 
obtained on„trial h and on the reminiscence trial. Since all measures 
are frequency counts, the data are appropriate for statistical analyses 
based on the multivariate normal sampling distribution. Hypotheses 
involving' ability and strategy measures will be considered separately 
in Chapter 7- . 

The. problem in analyzing these data is to. extract information relevant 
to hypotheses concerning first , the nature of the processes which 
generated the semantic information which subjects acquired from the 
experimental text, and '^-^ond, thj^^^eJ^ect s of the contextual conditions 
and repeated exposures to t7tie--^fer^xt , on these processes. We will begin" 
by considering hypotheses concerning normal processing activities in 
a "natural" (arbitrary') discourse context, hypotheses which involve only 
the data obtained under condition A. Considered will be hypotheses 
concerning (l) limits on processing caprcity (given a single exposure 
to a textual input);. (2) extent of ^iustment to such limitations through 
imperfect discrimination or simplification of conceptual information 
and use of generative.jprQcessing operations (with a single exposure to 
a text); (3) effects of repeated exposures on processing limits, 
simplification, and extent of generative processing; and (U) possible 
changes occurring in reminescence • These hypotheses will be considered 
for both conceptual and relational elements. Hypotheses concerning 
effects of the experimental conditions, which* were designed to, induce 
"superordinate" processing operations on 'semantic information acquired- 
from a passage, will then be considered. Hypotheses will be considered 
concerning (5) effects of the experimental conditions on generative 
processing operations and (_6) changes in tbese effects with repeated 
exposures to the text and CT) in reminiscence* Finallv similar 
effects will be considered involving comparison of the incidental 
memory condition with the other two conditions. These latter hypotheses 
concerning process invariance will involve comparison of experimental 
groups A and B on five trials, and , comparisons among all three groups 
on trials four and five. Hypotbeses concerning the stochastic growth 
properties of response class measures .(.over trials!, process independence, 
and the role of genera^tive processes (^at input or at output) will be 
considered in the next chapter. The primaiy issue which, underlies 
many of the hypotheses to be considered is: should' the sequence of 
processing operations which is involved in normal comprehension be 
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regarded as primarily an interpretive systei^ "n vhlch surface and syn- 
tactic information present in a text are analysed and interpreted 
semantic ally resulting in a repre^^entat ion in memory of the semantic 
information vhicL vas explicitly coded in a text; or should it he regard-- 
ed as primarily a pienerat ive system in which semantic information is 
generated (in the manner described in the previous chapter) in an attempt 
to synthesize that conceptual and relational information vhich a 
speaker is attempting to express? A classification and statements 
of specific hypotheses concerning the above issues f ollovs , 

I, Hypotheses involving Group A alone [concerning characteristics 
of processing activities in "normal" comprehension] 

A. Limits on processing capacity , trial 1 recall . (single presenta- 
tion) J 

The processing operations which we suppose are necessary to 
semaritically interpret an input discourse consists of the 
following sequence- A semantic interpreter must: (l) generate, 
a string of words and syntactic markers from acoustic inputs, 
(2) identify each concept by retrieving appropriate semantic 
information, (3) use surface and syritactic information to generat 
a relational structure linking these conceptual categories , and 
(U) store the resulting structure. For a single "sentence , 
a certain amount of time would be required for each of these 
processing operations. Thus, it is reasonable to suppose that 
elements of surface structure are generated' at a time approximate 
ly contiguous with the input of the relevant acoustic information 
(with a lag corresponding to the processing time), that semantic 
interpretation (concept identification and generation of semantic 
relations) requires additional processing time and hence occurs 
with a greater lag. after each word phrase or clause and that 
storage of generated semantic information in long term memory 
requires still more , processing time and occurs largely after 
a clause or sentence has been presented. These considerations 
lead to the following .expectations when a discourse consisting 
of multiple sentences is presented: 

1. A discourse will normally exceed the capacity of the 
system to completely process and store all of the 
semantic information contained in the discourse, 
since the succession of sentences (clauses) will 
normally prevent the semantic interpretation and storage 
of the resulting semantic information * from being 
completed. Thus , the amount ox"^ reproduced semantic 
information (veridical concepts and relations) present 
in subjects' recall protocols should represent only 

a fraction of that actually contained (explicitly 
coded) in the presented discourse.-^ 

2, The proportion of relations reproduced should be 
less than the proportion of concepts reproduced, 

O since the generation of relations connecting concepts 



requires more extensive processing than the generation 
of concepts. 

Adjustments to limits on processing capacity-^ trial 1 recall ; ■ 

Given that these limitations on processing capacity exist 
for every discourse, it is likely that a semantic information 
processing system woiild adjust to these limitations by 
systernmatically' selecting that semantic information which is 
to "be acquired on the "basis of either surface or semantic 
characteristics of the input discourse (or both.). Semantic 
information explicitly represented in a discourse could be 
systeramatically reduced in the following two ways : 

.1. Conceptual classes may be simplified or imperfectly 
discriminated ^ resulting in incompletely specified 
conceptual categories (overgeneralized concepts) • 
and relations connecting incompletely specified 
concepts in subjects', recall protocols. 

2* > An efficient way to reduce the "informational load" 
presented by a discourse would be to acquire 
information generatively . Thus, semantic information 
may be generated from previously acquired semantic 
information and from elements selected from the 
current linguistic input in an attempt to "infer^' 
'* conceptual and relational information without 
. completely analysing the input discourse (i.e, , in the 
manner described in the previous chapter ) . Such 
a method of adjusting to limitations on processing ■ 
capacity ought to result in the presence of large 
nujnbers of ^inferred concepts and relations in subjects' 
recalls. One would also expect to find relatively 
, more inferred relations than concepts. 

Effects of repeated exposures : 

Repeated exposures to a text should result in the acquisition 
of new explicitly coded semantic information on each exposure 
to the text. As the amount of new information remaining to 
be acquired decreases, the '^informational load'* on the compre- 
hension-memory system would be consequently reduced. Thus, 
repeated trials should res^^lt in f " 

1. Increased frequencies of reproduced (veridical) 
conceptual and relational elements in subjects' 
recall protocols ; 

2. Negatively accelerated increases in frequencies of' 
incompletely specified concepts and relations involving 
incompletely specif ied concepts Csince progressively 
less adjustment to -limitations on processing capacity 

■would be necessary with successive exposures to a 
discourse ) ; 
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3. Negatively accelerated increases in inferred concepts 

and relations since ach,ieving a reduction of the "infoma- 
tional load'* induced by a discourse by generative 
processing would become less important as the ammin-* 
■ of **nev information*' remaining to be acq^r' . „^u;u.--- 

..uxge-^ 1:. re:: .' .isce nc e : 

Changes i'. frequencie s of reproduced, over^^ 5?neraliz ed , and 
inferred -oncepts and relations in i minisc-^nce reflect the 
sort of changes described by Bartlet 193^ , viz. reductions . 
in the njnount of reproduced semantic inforr. '.tion' and simplifi- 
::ation of that information g.s it is econstii^uct ed. In 

dditic :, as previously stored semar.'^- c information becomes 
.:ore difficult to retrieve ^ one might: .Iso expect that more 
semantic information would be generar^ei inferentialJy from 
that conceptual ai d relational infori..;it ion which is retrieved. 
These consideratie <as lead to the following expectations, 

1, Frequencies of reproduced veridical) concepts and 
relations should decrease in remini£:Gence . 

'2. Frequ-ncies of .overgeneralize concepts and relations 
involving vergeneralized 20^ : fpts f ;^.ould increase 
( simplif ic ttion) • 

3. Frequencie: of subject-generated inferred concepts and 
relations should increase, 

II. Hypotheses involving Groups A and B [concerning process in^ariance - 
and effects f the contextual conditions]^ 

A, Context invariance cf all results- hypothesiz i under I . above : 

Insofar as th- expe- imental discourse presen^ ; a degree of 
information load under contextual condition which is similar 
to that under cdndi*:ion A, the predictions inrolving: limits 
in processing capacity and adjustments to lir. ' ts in processing- 
ca-r^acity which were made for contextual condition A should 
re licate for condition B. 

' B, Effects of contextual cc :ditions on discrimination of conceptual 
categories : 

VThile the problem solvinr context was designed to induce 
inferential oj'^rations o: semantic information contained in 
the presented discourse, it may also increase tbe ''in^ormatical 
load** on a subject. rhus , the extent J" simp, ii.icat ion of 
concept ual cat- .;o^'-es Ccvergeneralizat ton) ma;' ce greater ur.^^r 
condit on B tV r ^.ider condit ion A. 

Effects of CO gal conditions on ez ' - nt of ge: ^rative 

O . procei^sing (s _e presentation): 
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If the problem solving cont-ext (b) described ].^/iously success- 
^ .1- aices "superordinate*' processing operations on the 

jeptual and relational information vhich is acquired from 
a discourse, these operations ought to have predictable effects 
on ":he specific classes of responses obtained from the semantic 
nalysis of subjects' recall protocols which reflect the affected 
r: "essing operations. The problem solving task involves, first, 
^nsidering the present state of Circle Island and the^'changes 
state vhich are expressed in the passage, and, second, 
■I- rring the effec:ts vhich specific introduced changes would 
ha e on the island's state. Thus, the task involves both 
(l.. generating hypothetical events and C2) inferring the 
er 3cts those hypo*::het ical" event s would have on the island's 
st ■ ce . 

1. The operations required by the problem solving task, 
then, should result in increased generation of 
inferred relations and (to a lesser degree) concepts ' — 
increased relative to the frequency of these elements 
in the '^natural" discourse context (A).. 

2. To the extent that the hypothetical im'ormation 
generated in problem solving is incorporated in the 
semantic structure representing the text ^ frequencies 
of elaborative concepts and -relations would also be 
expected to increase in comparison to their frequencies 
in condition A. 

Effects of repeated exposure on contextual differences in extent 
yf generative processing : 

1. The effects of the contextual conditions on frequencies 
of inferred concepts and relations predicted above 
should increase with repeated exposures to the text 

as a negatively accelerated function. Tt?.e increased 
effect is expected since the exploration of consequences 
of hypothetical actions should ^increase as more semantic 
information is acquired from the passage. 

2. Since the set of hypothetical actions which may be cdnsi-- 
dered in problem solving is limited and since many of 
these solutions are likely to be generated after the 
first exposure to the text, effects of the experimental 
contexts of frequencies of elaborative concepts and 
relai:ions ought to be less apparent on trials subsequent 
to the first . - 

III. Hypotheses invcl^ing Groups A, B, and C I concerning process 
inva^riance and effects of the contextual conditions j3 A' ;: 

Under the -^cidental memory condition, conceptual and relational 
^ informal Ion -explicitly^ coded in the pr^-'sented discourse wo\ild be 
ERiC ^^P^^"*^^" r-itained only if it were related to problem solution. 
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Thus,- it is reasonable tp expect that under the incidental memory 
conditiQn Ccl the hy^Dothesized effects of the contextua^l conditions 
on sijTjplifi caption and e:3rtent of genera^tive processing (hypotheses 
IIB and IID) vill occur to a greater extent than under condition B, 
This result should "be particularly apparent if the data were 
expressed as relative f requencit=rs and thus equating the groups in 
terms of total semantic information acquired from the discourse. 
It is also reasonable to expect that frequencies of reproduced 
(veridical) concepts and relations vill be less than those obtained 
under conditions A and B given an equivalent ntmiber of exposures 
to 'the ■ passage . 

A, Inferred concepts and relations : 

] The experimental groups should be ordered A<B<C in terms 
I of ■ frequencies of inferred concepts and relations. .The ." 

separation should be greater for relations than for 

concepts . 

B. Elaborative concepts and relations ; 

The same ordering is expected but with less separation 
of the groups . 

C« Simplification of conceptual categories : 

The same ordering is' expected with respect to "frequencies 
of overgeneralized concepts. \. 

The import of these predictions should be clear; tlhat even under 
^'normal*' (arbitrary) conditions in which a discours^ is imderstood, 
comprehension involves a process of inferring a spedfcer's semantic 
knowledge from fallible and incomplete linguistic inputs; axid that the 
manner in which an individual uses knowledge transmitted in a text will 
affect the nature of the semantic information he acquires from the text , 
the means by which he acq;uires that information, -and Wence his 
"comprehension'' of the text. [ 
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Results 

Results obtained from analyses of mean frequencies of various classes 
of responses in different contexts are presented in the Tables and 
Figures which follow. The results will be presented in an order 
corresponding to that in which the relevant hypotheses were presented. 
Consider first hypotheses (involving Condition A alone) concerning 
characteristics of "normal** processing activities ^ in particular 
hypotheses involving: (lA) limits on processing capacity^ (IB) adjust- 
ments to limits ,on processing capacity 5 (iC) effects of repeated 
exposures^ and (ID) changes in reminiscence. The results relevant 
to Hypothesis lA are presented in Table 5.1 and are included in the 
graph in Figure 5.1, The amount of reproduced conceptual information 
acquired after a single exposure to a text is about 20 per cent (for 
condition A). Fiorthermore 3 the figure obtained for semantic relations 
is 8. 6 per cent 3 and for conditional relations the figure is 3 per 
cent. The frequencies of <ixplicit concepts, semantic relations , 
and conditional relations contained in Circle Island were 92 , 68, and 
12 respectively. Frequencies of conditional relations we^-e probably 
much too small to permit reliable estimation of what ti^ese proportions 
would be for a text containing a more extensive logical structure. 
Hypotheses IBI and IB2 involve the expectation that significant 
freqv.encies of overgeneralized and inferred concepts and semantic 
relations will occur. The relevant data are included in Tables 5.2 
and 5*3* Pooled -wi thin-group standard deviations may be used to place 
confidence limits on their corresponding mean frequencies of over- 
generalized concepts and relations indicating that the observed 
frequencies of overgeneralized concepts and relations are statistically 
significant. Concepts may also be transformed by including too much 
differentiating information in the concept. Frequencies of such 
pseudodiscriminated concepts (and 'semantic relations involving 
pseudodiscriminated concepts) indicate that this latter process also 
occurred. 

Frequencies of inferred concepts and relations are found in Table 5.3 
^and plotted in Figure 5,1 (see condition A, trial l). The results 
indicate that significant numbers of inferred concepts and semantic 
relations were generated by the subjects. Especially interesting is 
the result that with a single exposure to the text, more inferred 
relations actually were generated than veridical relations were 
reproduced. The prediction concerning the relative, extents of inferen- 
fck^ concepts and semantic relations, viz, that relatively more 
inferred semantic relations than concepts would occur, is confirmed by 
^hese data, where frequencies of inferred concepts or semantic relations 
are taken relative to frequencies of veridical concepts or semantic 
relations respectively (cf. Figure 5.I). Relative frequencies of 
conditional relations continue this trend, although the absolute 
frequencies may be too low to permit generalization to textml materials 
containing more extensive logical structures (of conditional relations 
linking propositions, cf. Chapter 9). SignificStnt frequencies of 
elaborative concepts and semantic relations were also obtained and 
are reported in Table 5.U. 

Results concerning the effects of re^^eated exposures to a discourse on 
the acquisition of explicitly coded/conceptml and relational information 
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and on adjustments to a resulting decrease in "information load'* 
(Hypothesis IC); are found in Tables 5* 1-5*3 and Figure 5.1. The mean 
frequencies of veridical concepts and semantic relations exhibit the 
expected negatively accelerated increase; extrapolation of the curve 
suggests that a great many more exposures to the discourse would be 
required to reach anything approaching recall of all of the explicit 
concepts or semantic relations contained in the text. Inspection of 
the changes in mean frequencies of overgeneralized concept and 
relations with repeated trials of exposure to the text in-. ates that 
very little increase occurred after the .second trial. In: .^red 
relations showed a slow rate of increase without the negatively 
accelerated form, suggesting that the generation of inf err :.^d relations 
would continue to increase with still more exposures to tb v text. 
Statistical analyses of these changes were made with respect to trial 
effects pooled over conditions A and B and are reported in Tables 5.5-5*7 
The analyses reported assess trial "main effects*' within the general 
multivariate linear model by computing differences between successive 
trial scores and testing the hypothesis that the grand mean vector 
of difference scores (for acquisition only, i.e,, for trials 1-U) is 
equivalent to the null vector. Univariate F's were also obtained for 
each successive difference, and step-down s were obtained to determine 
whether successive differences (e.g., increments) are independent of 
differences occurring on previous trials. (The univariate tests are 
analagous to comparisons involving trials in the familiar ^'repeated 
measures*^ analysis of variance model for xincorrelated- response measures.) 
The results (see the first three columns of Tables 5.5-5'?) indicate 
significant trials effects for all response classes except inferred 
concepts. For veridical concepts, significant increments were obtained 
on each trial after the first, and these increments were independent 
of previous increments. Significant increments occurring on trials 
after the second are also apparent for overgeneralized concepts and 
semantic relations, inferred semantic relations, and elaborative 
concepts and semantic relations. In general, these results are con- 
sistent with the hypotheses concerning effects of repeated exposures on 
processing activities in '^normal" comprehension. The above results 
also appear to hold under contextual condition B, as expected (Hypo- 
thesis IIA). 

Finally, consider the hypotheses involving changes occurring in reminis- 
cence (Hypothesis ID). Inspection of Figure 5.1 and Tables 5*1, 5.5, 
and 5.6 indicates that a significiint decrease in the number of veridical 
concepts and semantic relations did occur (Hypothesis IDl) , but with 
the interesting result that these decrements are not independent of • 
previously occurring increments. Thus, evidently, decrements in the 
amount of reproduced semantic information are predictable from the 
previous changes which occurred during acquisition. The correlations 
of the changes in frequencies of veridical concepts and semantic 
relations on trial k with changes in these frequencies on the reminis- 
cence trial are -.57^ and^-.536 respectively e The correlations 
reported are pooled estimates based on the data obtained under both 
conditions A and B (i.e., pooled within-group estimates) and- are 
significant (p < *00l)* These correlations indicate that for persons 
for whom the rate of increase in veridical semantic information * 
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Table 5.5 

Analyses of Variance of Inter-Trial Differences in Free . ,)cies of Veridical, 
Qvergeneralized, and Pseudodiscriminated Concepts Testir.i^ Trials Effect 
(Hypothesis that Grand Mean Vector of Difference Scores is Equivalent to 
Null Vector) and Effects Du to Conditions, Sex, and Interaction, Groups A and B 











(a) 














Tr: als 




Cc. 


iditions 






(Gran: Mean) 












Uni- 


St£.n- . 


Multi- 2 


Uni- ^ 


Step- 


Multi- 2 






1 

variate 


Dc -n 


variate 


variate 


Down 


var late 


R-.;, ponse 
















Z ass 


Trials 


F 


F 


F 


F 




F 


Veridical 


2-1 


308.96*** 






1.03 




1.74 


Concepts 


3-2 


114. 62*'!'* 


20.88*** 


149.31*** 


3.39 


3.57 




4-3 


48.15*** 


10.40** 




.02 


.61 






R-4 


79.58*** 


.17 




1.34 


.74 




Over- 


2-1 


47.97*** 






2.45 






generalized 


3-2 


.34 


3.92 


20.25*** 


.01 


.32 


.95 


Concepts 


4-3 


.76 


4.99* 




.00 


•13 ^ 






R-4 


.09 


.18 




.81 


1.07 




Pseudo- 


2-1 


19.82*** 






.14 






discriminated 


3-2 


.46 


3.44 


8.05*** 


.05 


.26 


1.16 


Concepts 


4-3 


.63 


.51 _ 




1.47 


3.05 






R-4 


2.19 


4.17* 




1.04 


.04 





(b) 



Sex 



Interaction 



Response 
Class 


Trials 


Uni- ^ 
variate 

F 


Step- 
Down 

F 




Multi- 2 
variate 

F 


Uni- ^ 
variate 

F 


Step- 
Down 

F 


Multi- 2 
variate 

F 


Veridical 


















Concepts 


2-1 


3.54 








.69 








3-2 


3*55 


2.97 




2*18 


1.32 


1.43 


.79 




• 4-3 


.01 


.01 






.00 . 


.25. 






R-4 


1.42 


.58 






- .13 . 


.52 




Over- 


2-1 


3.68 








.03 






generalized 


3-2 


.00 


.78 




1.57 


1.16 


"1.57 


,90 


Concepts 


4-3 


.00 


.29 






2.14 


1.11^ 






R-4 


.05 


.13 






.91 


3.54 




Pseudo- 


2-1 


. .00 








.00 






discriminated 3-2 


1.08 


1.62 




.59 


.19 


.29 


.11 


Concepts 


4-3 


.10 


.15 






.23 


.05.- 






R-4 


*10 


' .29 






.02 


.00 




1. d.f. = 1 

2. d.f. = ,3 


,92 
,90 














* = p < 
** = p < 
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Analyses of Variance of Inter-Tr. . 1 
Overgeneralized, and Pseudodiscr . ...ir. 
Effect and Effects Due to Condition:. 



erenc^ in Frequencies of Veridical, 
i Sema., c Relations. Testing Trials 
IX, anc iteraction; Conditions A and B. 



Trials Conditions 
(Grand Mean, 



Response 


ir lals 


Uni- ^ 
variate 

r 


Step- 
Down 

F 


Mu. ■.: ^ 


-::riate-^ 
F 


Step- 
Down 

F 


Multi- 2 
variate 

F 


Veridical 

Semantic 

Relations 


2- 1 

3- 2 

4- 3 
R-4 


274.13*** 
120,65*** 
60.18*** 
98.02*** 


29.26*** 
11.27** . 
.15 


j ,^7.54*** 

j) 


2.30 
3.13 
.02 

,17 


3,06 
.03 , 
.13 


1.79 


Over- ' 
generalized 
Semantic 
Relations 


2- 1 

3- 2 

4- 3 
R-4 


70.40*** 
.03 
.77 
.58 


9.72** 
9.57** 
3.25 


34.84*** 


.24 
.45 
.28 
.06 


1.02 
.01 . 
.22 


.42 


Pseudo- 
discriminated 
Semantic 
Relations 


2- 1 

3- 2 

4- 3 
R-4 


12.76** 
3.71 
.79 
.11 


12.68** 
5.58* _ 
4.04* 


11.33*** 


,00 
.03 
1.14 
,25 


.02 
1.65 ^ 
.10 


* 

.56 










(b) 














Sex 




Interaction 


Response 
Class 


Trials 


Uni-- ^ 
variate 

F 


Step- 
Do wri 

F 


Multi- 2 
variate 

F 


Uni- ^ 
variate 

F 


Step- 
Down 

F 


Multi- 2 
variate 

. F ' 


Veridical 

Semantic 

Relations 


2- 1 

3- 2 
4^3 
R-.4 


2.07 
4.31* 
.32 
• 2.47 


4.12* 
.44 _ 
.51 


2.22 


.21 
.73 
.30 
.44 


.73 

.46^ 

.07 


^ .46 


Over- 
generalized 
Semantic 
Relations 


2- 1 

3- 2 

4- 3 
R-4 


2,27 
.16 
. .88 
.11 


- 1.45 
.05 
.02 


1.25 


.05 
1.25 
.94 
.01 


1.29 
.44 
.65 


.59 


Pseudo- 
discriminated 
Semantic 
Relations 


2- 1 

3- 2 

4- 3 
R-4 


.12 
.32 
.01 
6.60* 


.62 

.31 _ 
12.10** 


.35 , 


.00 
.42 
1.24 
.01 


*49 
.76 
.63 


.42 



1. d.f . = 1,92 * = p < .05 

2. d.f. = 3.90 ** = p < .01 

*** = p < .001 
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Table 5.7 

Analyses of Variance of Inter-Trial Differences in Frequencies of Inferred 
and Elaborative Concepts and Semantic Relations Testing Trials Effects and 
Effects Due to Conditions, Sex, and Interaction, Groups A and B. 

(a) 



Trials 
(Grand Mean) 



Conditions 







Uni- , 


Step- 


Multi- 2 


Uni- ^ 


Step- 


Multi- 2 






var iate 


Down 


variate 


variate 


Down 


variate 


Response 
















Class 


Trials 


F 


F 




F 


F 


F 


Inferred 


2-1 


1.47 






1,88 






Concepts 


3-2 




1 . 03 


1 , 91 


,18 


.49 


1^21 




4-3 


2.32 


3.17 




.03 


1.27 






R-4 


5.14* 


3.16 




.15 


.02 




Inferred 


2-1 


7.68** 






3,33 






Semantic 


3-2 


3.07 


9.33** 


6.01*** 


,10 


.23 


1,28 


Relations 


4-3 


3.86 


.43 _ 




.03 


.32 






R-4 


5.10* 


8.90** 




.09 


.20 




Elaborative 


2-1 


4.88* 






1.70 






Concepts 


3-2 


18.51*** 


21,57*** 


17.06*** 


1.72 


1.15 


1.19 




4-3 


7.08** 


18.i40***^ 




1.67 


.72 






R-4 


20.33*** 


4.70* 




.GO 


.51 




Elaborative 


2-1 


• .79 






1.36 






Semantic 


3-2 


15.29*** 


18.33*** 


11.87** ' 


.14 


.51 


.98 


Relations 


4-3 


3.24 


13.66***^ 




.36 


1.08 ^ 






R-4 


11.79*** 


1.38 




.24 


;05 





(b) 



Sex 



Interaction 



ERIC 



Response 



Uni- ^ Step- 
variate Down 



Multi- . 
variate'' 



Uni- ^ Step- 
variate Down 



Multi- . 
variate 



1. d.f. s 1,92 

2. d.f . « 3,90 



Class 


Trials 


F 


F 


F 


F 


F 


F 


Inferred 


2-1 


1.25 






.37 






Concepts 


3-2 


1.10 


1.65 


1.26 


3.54 


3.18 


1.29 




4-3 


.21 


.88^ 




.56 


.34 






R-4 


.91 


1*18 




.88 


.17 




Inferred 


2-1 


.19 






.21 






Semantic 


3-2 


.49 


.93 


.38 


.07 




.09 


Relations 


4-3 


.03 


.02 




.07 


.05 






R-4 


.66 


.41 




.43 


.52 




Elaborative 


2-1 


2.99 






1.32 






Concepts 


3-2 


1.27 . 


.65 


1.23 


; 1.03 


.65 


.73 




. 4-3 


.48 


.09 




.68 


.23 - 






R-4 


.01 


.23 




4.78* 


3.36 




Elaborative 


2-1 


4.70* 






.00 






Semantic 


3-2 


2.59 


1.04 


2.06 


.36 


.40 


.85 


Relations 


4-3 


.08 


.48„ 




1.13 


2.15 




R-4 


.03 


.00 




2.74 


.96 





— p 

** = p 

ifcik it » p 



.05 
.01 
.601, 
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with repeated exposures to a discourse is high, relatively more explicit 
semantic information is lost in reminiscence than for persons exhibiting 
a smaTler rate of increase during acquisition. Such a result would he 
expected if, say, a constant proportion of the previously acquired 
semantic infonriation were lost during the retention interval- The 
results obtained for overgeneralized concepts and semantic relations 
involving overgeneralized concepts indicate that no significant 
increments in these frequencies occurred in reminiscence (see 
Figure 5-1 and Tables 5.2, 5.5, and 5 .-6). Thus, the data do not 
indicate that conceptual simplification increased in reminiscence. 
However, frequencies of subject-generated inferred concepts and 
semantic relations did increase as expected in reminiscence (Hypothesis 
ID3) and the observed increases were statistically significant and (for 
the inferred semantic relations) independent of previous increments 
which occurred during acquisition (cf. Tables 5-3 and 5.7). Thus 
there is evidence for an increase in inf erentially generated semantic 
• information in reminiscence. These results also appear to hold under 
both contextual conditions; 

Now consider the hypotheses (involving conditions A and B) concerning 
process invariance and effects of contextual conditions on processing 
activities in the acquisition of semantic information from discourse 
and, hence, on semantic information resulting from these processes. 
In particular we will- cc^nsider hypotheses involving: (IIA) contextual 
invariance of all results involving limits on processing capacity, 
adjustments to limiits on processing capacity,- and effects of repeated 
exposures to a discourse; (IIB) effects of contextual conditions on 
the discrimination |Of conceptual categories; (lic) effects of contex- 
tual conditions on ^extent of generative processing; and (IID) effects 
of repeated exposures on context-induced differences in extent of 
generative processing. The results relevant to Hypothesis IIA have 
already been presented and indicate a rather striking degree of 
invariance of those aspects of the data which were interpreted either 
as resulting directly from those limitations on processing capacity 
which are encountered when a discourse is processed, or from adjustments 
to these limitations. 

In Hypothesis IIB it was suggested that one effect of contextual 
condition B would be to increase the '^informational load^* on a subject 
(i.e., the sheer amomt of processing required) and hence result in 
an increased tendency to simplify conceptual categories by overgenerali- 
zation. The relevant data are the mean frequencies of overgeneralized 
concepts for each contextual condition, A and B, (reported in Table 5.2) 
and mean frequencies of semantic relations involving overgeneralized ' 
concepts (reported in the same ^ Table and plotted in Figure 5.2). The 
results indicate that differences in the predicted direction were 
obtained and that these differences increased slightly with repeated 
exposures to the text* An analysis of variance of frequencies of over- 
generalized concepts (Table 5.8) indicates statistically significant 
main effects of contextml conditions for trials 2 and 3, but that the 
conditions effect, on trial 3 is not independent of that obtained on 
trial 2." Thus, there is some evidence to indicate that the observed 
effects on fl-equencies of overgeneralized concepts to some extent are 
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cumulative. Sex main effects are also significant, indicating a 
statistically reliable tendency for females to produce more overgeneral- 
ized concepts than males. This sejc effect may "be due in part to a tendency 
for the females to produce more semantic information which can he identi- 
fied vith information which was explicitly represented in the input 
text. No significant interactions of contextual conditions with sex 
were found. An analysis of variance of frequencies of semantic relations 
involving overgeneralized concepts resulted in nonsignificant main 
effects due to conditions, significant sex main effects on trials 2 and 
. 3, and on the reminiscence trial, and no significe-nt interactions. 
Step-down analyses of sex effects reveal that the observed differences 
on the reminiscence trial reflect a cumulative growth in overgeneralized 
semantic relations during acquisition. Analyses of variance of frequen- 
cies of semantic relations involving pseudodiscriminated concepts 
(Table 5-9) resulted in a significant main effect of contextual conditions 
on trial 1. Thus, when compared to context A, context B appears to have 
produced a greater tendency to reduce the amount of "conceptual" information 
through overgeneralization while at the same time producing a lesser 
tendency to overspecify conceptual classes by attaching additional self- 
generated information to the concepts. . 

Hypothesis IIC involves the effects of the problem solving context on 
the generation of semantic information which does not correspond to 
. information explicitly represented in the input discourse. It was supposed 
that the problem solving task requires that the subject acquire only 
that information from the discourse which is necessary to evaluate the 
effects of various solution-oriented hypothetical events which the subject 
trenerates himself. These activities should result not only in selective 
acquisition of explicitly represented information, but should also 
produce more extensive inferential processing as solutions are evaluated. 
Thus It was expected that context B would produce increased frequencies 
of inferred semantic relations (and to a lesser extent, concepts). The 
mean frequencies of inferred concepts, semantic relations, and conditional \ 
relations for conditions A and B are presented in Table 5.3. • Viridical 
inferred, and elaborative semantic relations are plotted in Figure 5.3.' 
The relevant statistical analyses are presented in Table 5.10. It is" 
apparent that the effects of the contextual conditions on frequencies 
of inferred semantic relations are as predicted and increase with repeated 
exposures to the discourse (Hypothesis IIDl). Also as predicted, these 
effects are more apparent for the relations than for the concepts. 

Mean frequencies of elaborative concepts and semantic relations are 
presented in Table 5.^. (see also Figure 5-3). First, it is apparent that 
frequencies of elaborative elements decline with repeated exposures to 
the text. Thus, as more explicit and inferentially derived semantic 
information is acquired, there is a concomitant decrease in the generation 
■ of elaborative information.-. Second, while the experimental condition (B) 
does appear to, have produced a greater number of elaborative concepts 
and semantic relations on trial one (Hypothesis IIC2) than, were obtained 
under the natural" context (A), the differences were not large enough to 
be- statistically significant (Table 5.10). The differences between the 
^ two contexts also appear to become smaller with repeated exposures to 
ERIC''^^^ general, contextual condition B appears to have affected 



ERIC 



o 



o 
cd 
u 

0) 

AJ 

c 

i 

O -x? 

a 03 

QJ 

^ s 

c 

03 - 

CO 

- c 

T3 O 
N 4J 

.H -a 
03 C 
^-1 O 

c 

<1> o 



0) 

»H U 
=3 03 

s > 



o 

Q 

to 



OJ 

C 03 

^3 > 



eg 



0) 
OJ 



S > 



O 







CO 












iH 


4J 




<u 


1 s 






03 


O 




CO 








O 


<U 


pq 










•H 














nj 


M-t 


T3 










-H 


W 












V-i 




03 












00 






1— J 






> 


c 


< 




0) 








u 


CO 




ij 

03 




<u 


'G 


CO 






J 








a; 


o 




•H M 


U3 


CO 








C 03 




03 


0) 








O > 






enci 


ons 


ondi 












•H 






CSJ 






cr 


4^ 






QJ 






QJ 


CO 






i "^Zl 








f-H 






•H cd 








Re 






4J -H 
iH M 
3 OJ 






o 


ic 






S > 




















o 


a 












c 


CO 












OJ 


6 




CO 


o 








<U 




c 


Q 








CO 




o 


1 






OJ 






•H 






• > 


ted 




dit 


Ste 






o 


na 




on 








CO 














0) 


$ 






rH 














0) 














JJ 








a 






OJ 






03 


CO 






1 -H 






C 


•H 






U 




<i 


T3 






C OJ 
> 





pt^ 



H 



CO 

c 

O (0 

P4 (0 

CO OJ 



























-K 










CO 










m 










<n 










in 










o 










VO 




















• 








































CM 






1 










1 


















































































































vb 








<!■ 










o> 


CM 


eg 








m 






a\ 


<r 




in 




O 


OJ 


O 




















/ 


















<r 








































































































•K 












o 












vO 


O 


0^ 


00 




in 




CNl 




rH 




00 




m 


o 


O 






SO 


o 


i-H 


o 


o 










CO 






\r> 


cjo 






iH 











CM 



\0 



1 r 



1 r 



CO o\ ir^ 
O CJN ^ 



cxD rH a% o cr« 

CNl LO <!■ iH vX? 



CO O O CO 

CO CO o 



rH oo in --3' 

O -<t CTi 00 



in <r CX3 CM 
vo o wo C7> 



o o 



in in 00 
CO r*. r>- 



o 



CO 



"1 r 



1 r 



in CO ro in 

CM O O i-H 

* • ♦ • 

CM CO 



CM CM CM O VO 

o in o o o 



CM a> m <t 

vO v£> o o 



I-H CM iH <!■ 
ro VO O^O 



o o o iH 
CM 00 in 



CM o oo o -<r 

1^ <r <t CO r-f 



-d- CM CM 



iH CM CO <t DC5 



I-H CM CO >cf DC5 















<u 




CO 




N 


CO 


a 




•H a 


c 


o 






o 


•H 




(d 4-1 


•H 


4J 




u c 


4-J 


OJ 


M 


(U 03 


OJ 


•H . 


0) 




iH 


0) 




§ 1 


0) 






00 CO 







CM 


CO 


<t .pi 














CM 












OA 


CO 




13 




4 








0) 












4J 








in 




OJ 












C 




CO 


H 


11 




•H 


U 


a 






1 




-H 


o 






O 




4-1 


•H 


U-l 


14-4 






c 


4-1 






a 


O 




CO 








CO 




rH 






CO 






(U 


• 














CM 



116 



in rH o 

o o o 



V V V 

a< ex 

11 ii u 



Q • 

<d C 
O 

O. O 

<ii cd 

O M 
O *J 

o c 

CD 

> -a 

•H C 

4J qj 
CO 

o 

CO CO 

w * 

CO 

c o 



*0 -H 

n c V 

U O PQV 

c o c 



CN 

i ^ 
J-J -H 
3 CO 

s: > 



o 

a 



CO 



a> 



CO 

*H U 

C CO 



CO 



o 



c 

CO 
01 <J 

c 

to o 



o 



O 4J 

<U iH 

3 »4-i C 
C7^ W O 

EX4 C 

•H 

»4-l 4-1 
O £0 
CU 

<U H 
O 

a CO 

•H O 

U -H 

' CO U 

> CO 

rH 

O 

(0 CJ 

CO 4J 

>. c 

iH (0 
CO B 

a Q) 

<J CO 



t4 CO 

*J -H pi-j 

3 CO 
S > 



O 

n 

a. 

CO 



C CO 



I 4J 

•H CO 

4J pcj 

1-t U 

3 to . 

S > 



O 

00 



CO 



n 



n r 



■n r 



0) 


o 


a 


n 


o 






p- 


U 




•H 


4J 




CO 






o 









I 



4-J 

CO 

Ti U 
C CO 

t3 > 



tn -^t \o <^ 

m »H iH 



vO CNJ o lO 

•<T o o m 



I 0\ CN CN 

tn CN 



VO O O CT> 

m o in iH 



117 



o 



CM 

o 



o m ro iH 
ro \0 vO 



cn ON CO in vO 
o CN o vo 



vo ir» cvj m 

C30 rO O 



vO ON 00 vO 
00 C7> M ^ 



CN 



CM 

00 



VO 



1 r 



T r 



r 



f-i CO in f-i 
cx) m CN 



ON 

O C5N o m 



cn CN o 

CN O O rH 



o rH m 
n m C30 o 



cx) O cx> <r 
'H o <r cx> 



m r-i i/i vo r>* 
iH o VO fn o 



n iH m C30 m 

CO O CN CN 



on oo CO ON ON 
m ON ^ oo -"^^ 



CN t-l 



NO 
ON 



vO 



1 r 



^ tn m iH 
CO tn ON 



C- J m CM C3N 
O CX3 CN 



<3N iH m 1^ 

ON O^ uO vO 



iH ON O 

o m o 



^d" ON in CN C30 

O CO iH CN O 



* * * 

CN ^ ON iH 
iH CO O sj- O 



n rH m ^ ^ 
cjN <j- m rn CN 



»H O iH o 
VO m o CN 



f-i C<1 cri <]■ 



in in tn cn 



iH CM CO ^ prj 



0) 




TJ 


U3 


(0 




01 










a. 


o 


(0 








CO 


01 


ric 


CO 


CO 




(U 


iH 


c 


o 


Pd 


CJ 


M 


u 







CO 




o 


c 


0) 




o 




iJ 






c 




0) 




(d 






rH 


c 


CU 






CO 





iH CM CO OcJ 



<1> 

CO 

CO 

U pa 

O 0) 

-o o 

CO C 

»H O 

W CJ 





CN 


<r 












CN 


OO 








ON 


<X> 


















iH 


tn 


> 












CO 


II 


If 




O 


c 






CO 


•H 


o 








4J 


•H 






o 


C 


4J 








CO 


CO 




t3 


CO 


§ 


iH 






rH 




01 








CO 






eg 



lis 



> 



O 

jQ 
JD 



"D 

M— 

c 



o 



CD 
> 




-1 cc: 



.5 



OJ 



O 
/ 



CD < O 




C\J 



< m 




ct: 

CO 



O 



FRir 



Aouanbejj. uoaiAi 



u 




•rl 




4-J 




C2 




CO 








OJ 










T3 






•H 


CO 


4-J 




CO 




M 




O 








CO 


<: 


rH 






cn 








o 




tH 




4-i 




•H 








C3 


(U 


O 


u 




u 




o 


t— 1 








:3 




4J 




K 




<D 




4-J 




c: 


u 


o 


•H 




t3 




*W 




}-i 


<D 


(U 






d 










o 






(U 


cr 


G 




'H 




oj 


o 


4-J 






OJ 


o 






cr 


CO 


Q) 




U 


O 




•H 

JJ 


c: 


oj 


CO 






0) 


;22 





in 



119 



the types and extent of semantic information acquired, (l) by inducing 
different degrees of "information load^^ on the subjects (and hence 
adjustments to such load), and (2) by inducing inferential operations on 
semantic information acquired from the discourse* Since the generation 
of elaborative elements may reflect a relatively unsucr^essful attempt 
to reconstruct explicit information from previously acquired information 
which is incomplete as well" as a generative process occurring as a dis- 
course is received, the presence of elaborative elements in a subject's 
recall protocol may reflect pror-sses other than (or in addition to) 
those indicated in Hypothesis 11 2. A similar ambiguity of course, also 
occurs in interpreting inferred semantic elements. Thus, if it were 
possible to demonstrate that generative operations actually occurred 
during input, it would then be extre^nely unlikely that' the experimental 
outcomes described above, could be due solely to events occurring during 
output (i.e. during reconstruction of knowledge acquired from the essay) — 
events which are in fact unrelated to the explanations presented in the 
hypotheses. This question will be investigated in the next chapter. 

Finally, consider the hypotheses (involving all three conditons, 
A, B and C) concerning the effe.cts of the inci<len^earinemory condition on 
the generation of inferred and elaborative concepts and semantic relations 
on the simplification of conceptual categories, and on the extent of 
veridical information acquired. Mean frequencies of conceptual response 
classes for all three conditions on trial k and reminiscence are reported 
in Table 5.11 and mean frequencies for classes of semantic -relations are 
reported in Table 5.12. Means are also plotted in Figures 5.2 and 5.3. 
Analyses of variance of all scores are' presented in Table 5.13. First, 
observe that, as expected, smaller frequencies of veridical concepts and 
semantic relations were obtained for condition C, indicatn^ng selectivity 
in the acquisition and long-term storage of explicitly coded semantic 
information. Since the incidental memory task requires only that the 
subject acquire information relevant to problem solution, it is reasonable 
to expect not only selectivity in information acquired, but also that 
relatively more information will be acquired in a generative manner. 
Thus, a subject's investigation of the consequences of an hypothetical 
solution may induce him to deduce additional facts about the island fron 
the information which was given in the essay. Thus, measured relative 
to the extent of veridical information . acquired, relative frequencies of 
inferred and elaborative elements should be greater than those obtained 
imder condition B and much greater than those obtained under condition A 
(Hypotheses IIIA and IIIB). The relative frequency data clearly support 
these hypotheses . For elaborative semantic relations, statistically 
significant effects of conditions were obtained even for the absolute 
frequency measure, and the absolute frequency of inferred relations 
under condition. C on trial k is higher than that obtained under condition 
A. Thus, the data are in agreement with the predictions of hypotheses 
IIIA and IIIB: \ the relative extent of inf erentially generated and other- 
self-generated semantic information is drastically increased in the inci- 
dental memory condition. While^ there may be an ambiguity as to whether 
observed inferred or elaborative elements reflect processes occurring at 
input or processes occurring at output ^ it is hard to explp-in how, if 
inferential processes occurred solely during recall, frequencies of 
inferred elements could increase and occur with such high relative fre- • 
„.jtuencies. No significant sex differences or, conditions by sex interatlons 
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were found for measures of inferred or elaborative semantic elements. 
Relative frequencies of overgeneralized concepts and relations involving 
overgeneralized concepts also appear to be greater for condition C than 
for either other condition (Hypothesis IIIC). 

The changes in reminiscence produced by condition C appear to be 
different from the changes produced by the other two conditions with 
respect to frequencies of inferred semantic relations. For context C 
there is a decrease in the number of inferred semantic relations in remi- 
niscence, while for conditions A and B there is an increase in reminiscence 
(see Figure 5.3 and Table 5* 12). An analysis of variance of reminiscence - 
trial h differences indicates a significant effect of conditions and a 
step-down analysis of absolute frequencies indicates that differences on 
the reminiscence trial are independent of differences on trial h (Table 
5.13)* This interesting result implies that the use of inferential 
processes to retrieve or reconstruct semantic information which has become 
less available after a long retention interval, while it does occur in 
situations in which the subject's semantic model is likely to consist 
predominately of viridical semantic information, does not occur in contexts 
in which the subject's semantic model contains a large proportion of infer- 
entially generated material. Thus information processing heuristics used 
to retrieve or reconstruct previously acquired semantic information appear 
to reflect the processing events which occurred during acquisition! 

. It remains to exajnnine data which reflect the acquisition of the .verbatim 
concepts which were embedded in the discourse presented to the subjects. 
Two response classes will- be considered: complete verbatim concepts and 
incomplete verbatim concepts in which verbatim information is missing from 
the subject's response. Mean frequencies of complete and incomplete ver- 
batim .concepts are reported in Table 5.1^ for all three conditions. Analyses 
of variance for conditions A and B are presented in Table 5 •15; analyses 
for all three groups are presented in Table 5*l6. Consider first the 
acquisition data (trials 1-U) for groups A and B. A highly significant 
trials effect (multivariate F (3,90) - 131. H) and significant step-do'T. 
F's for trial -by-trial difference scores indicate that cumulative learring 
of verbatim concepts occurred. In addition, the verbatim measures arc the 
only measures in which • significant interactions of conditions, with se:: ^re 
found. However, when complete and incomplete verbatim concepts are pcjled, 
sex differences disappear. A similar situation appears to hold for ttr 
reminiscence trial. Thus, if 'accuracy is discounted, the acquisition ar.ji 
retention' of verbatim information is unaffected by the contextual -::ondi xions . 
Condition C, on the other hand, produced a significant main effect on the 
acquisition of complete verbatim .concepts but the effept on reminiscence 
scores is not independent of the differences produced during acquisition. 
These last results involving condition C would appear to reflect the pro- 
cess of selection of relevant information whi6h was observed previously. 
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CHAPTER 6 

A QUANTITATIVE INVESTIGATION OF SOME ALTERNATIVE 

PROCESS MODELS 



6,1 Introduction 

The results which were presented in the previous chapter were found to 
be generally consistent with a view of discourse comprehension as a 
process which normally involves interring a speaker ^s semantic structural 
knowledge from linguistic inputs which occur with such rapidity that 
complete interpretive processing is rendered impossible. It was also 
found that the axtent of such generative processing ma;, _ fleet , contextual 
conditions as well as semantic properties of the discourse itself. 
However, there was found to be one source of ambiguity in these results, 
an ambigui'cy which, if resolved, could significantly increase the weight 
of eviaence in favor of a ger,erative as opposed to an interpretive view 
of the process of knowledge acquisition from discourse. The ambiguity in 
question involves the temporal locus and function of generative operations 
in discourse comprehension. Since all semantic measures were obtained 
from recall protocols, measures which reflect inferential or elaborative 
processing can represent results of either generative processing opera- 
tions occurring at input (an a discourse is received) or those occurring 
at output. One purpose of :he present chapter is to attempt to resolve 
this ambiguity by means of .j.uantitative ■ investigation of the multi- 
occassion intercorrelations of frequencies of veridical ^ inferred, and 
elaborative relations. The method involves , first, assiauiing that all new 
explicitly represented Infonnation which is acquired, is acquired during 
the presentation of the discourse (i*e. during input). Second, given 
this assumption, the interpretive processing model and generative process- 
ing models are shown to lead to different conclusions with respect to the 
sources of observed stochastic growth of inferred and elaborative rela- 
tional structures* Third, each of these conclusions is converted into 
a mathematical model which Cixpresses precisely the quantitative outcome 
associated with each process model. Finally, each of the alternative 
mathematical models is fit to the matrix of multi-trial intercorrelations 
of veridical, inferred, and elaborative relations and a statistical 
measure of goodness-of-f i t is obtained. The fits of the alternative 
models are then compared* 

A second purpose of the present chapter is to investigate questions 
concerning process, independence, e.g. concerning the extent to which the 
processing operations involved in generating inferred structural elements 
are independent of those involved in acquiring explicitly coded semantic 
information. Thus, if there are inferential processing operations . which 
are involved in generating inferred semantic information and which are 
not involved in acquiring explicitly coded information, then these gener- ■ 
ative processing operations ought not to be statistically dependent on 
the occurrence of interpretive processes. Put another way, the acquisi- 
tion of an explicitly coded relation requires the first four levels of 
processing identified In Figure 4.2 (phonetic interpretation, generation 
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of a surface structure, parsing, and semantic interpretation); the 
acquisition of an inferred relation requires an addlti* 1 level of" 
processing (generation of a new element of semantic srriicture), the 
occurrence cf which ought to be independent of the previous .sequence of 
processing events. In terms of data consisting of ob .served frequencies 
of veridical and inferred relations, these two resp:::nse classes both 
result from similar interpretive processing operations which they -have 
in common, but the inferred relations also result from certain generative 
processing operations. In factor analytic terms, measures of veridical 
and inferred relations should share a common (general) factor, while 
there should be an additional factor common only to measures of inferred 
relations, a factor which is .uncorrelated with the general factor. 

In the previous chapter the mean frequencies of various classes of response 
obtained ±ron: the semantic analysis of subjects' recall protocols were 
studied; zs^ this chapter the statistical dependence sr^jicture o:' these 
response rrrvjaeures will be studied by f ittz.ng stochast-. models to the 
matrix of intercorralations of certain of the measures: frequencies of 
veridical, inferred, and elaborative semantic relaticnv » The models 
which,.are investigated were designed to investigate bov:: of the above 
questions questions concerning process independence ana concerning 
alternatl' sources of observed stochastic growth. The chapter will 
begin by c—nribing four alternative- stochastic growth models which will 
be studied ^d each of which is related to different assumptions concerning 
the processes which generated the data. It will then show how these 
models rel:ite to the question, '*Do generative processes occur at input?'' 
Results obrarned from fitting each of the four models then will be 
presented ro ascer1:2:in which model best accounts for the data. Finally, 
results concerning the effiects of the contextual conditions on the 
goodnes3-c-z-f:lt of alternative models viH be presented. . . 

6.2 SimT:lex models and Alternative Sources of Stochastic Growth 

The modej.s x^ch will be described in this section were designed to 
investigate i:iternative sources* of correlated growth in multiple response 
measures x^iz^ah are observed simultaneously at successive points in time. 
The data vhich models are fit are wi thin-group (or pooled within- 
group) mul:.imeasure multi-occasion correlation matrices based on ' 
measurements of veridical, inferred, and elaborative semantic relations 
obtained from the analysis of subjects' written reconstructions of knowledge 
acquired in comprehending and remembering information presented in 
texts. Recall that- repeated measurements were obtained from written 
protacols obtained after each of four exposures to the discourse. The 
models will be fit to investigate possible alternative explanations of 
observed growth in certain measure types which may result from more than 
one level of processing. Thus* if a measure involves additive effects, 
associated with two levels of information processing, observed growth 
in the measure may be due to (1). growth in one effect, (2) growth in 
the other effect, 'or (3) independent growth in both effects. In addition, 
these effects may be the result of processing operations which may be 
either independent or dependent. The models fit have two levels. The 
first level involves either (a) growth properties of each constituent 
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effect represented by Markov simplex growth models or (b) constant 
effects not representing a process of stochastic growth represented by 
Spearman models (c . f . Joreskog, 1970a, b) . The second level involves 
the combination of effects which are nypothesized to account' for the 
dependence of one set of semantic resT^onse measures on another. For 
example, one might assume complete inaependence : that there are nO 
effects common to different classes or response, or alternatively a 
hierarchical model : that there is one process common to measures of 
veridical, inferred, and elaborative relations, that there is a 
second additive effect representing results of inferential processing 
which is common to measures of inferred and elaborative relations, and 
that there is a third additive effect representing *^uncons trained 
generative processing*' (elaboration) which is present only for the 
measures of elaborative relations. By fitting models which make assump- 
tions at both of these levels, it will be possible to simultaneously 
investigate questions of process independence and of alternative sources 
of observed stochastic growth. 

The specific questions to be answered relate to: (1) determining whether 
the production of veridical, inferred, and elaborative structures can 
each be considered to be a growth process, or , alternatively , determining 
whether the observed growth in inferred and elaborative structure are. 
due to growth in the veridical (simply encoded or interpreted) structure; 
(2) determining whether there are distinct and mutually independent 
processes associated with the development of these structures; and (3) 
determining which hypothesis, the interpretive or the generative, best 
accounts for the growth properties of the data. Four models, each of 
which repres^ts specific assumptions in relation to questions *(1) and 
(2) will, now be described. Then the relationship of each model to the 
theoretical issue (question 3) will be specified. 

The above related questions will be investigated empirically using the 
available correlation matrix by expressing the various assumptions .quan- 
titatively as models involving both additive effects of factors associated 
with interpretive, inferential, and elaborative processes, and Markov 
simplex growth properties for certain of the additive factors (c.f., 
Joreskog, 1969, 1970a). Table 6.1 contains pooled within-group estimates 
of the multi-occasion correlations of response class frequencies of 
veridical, inferred, and elaborative semantic relations obtained under 
conditions A and B. Inspection of Table, 6.1 suggests that the inter- 
correlations of the veridical relations measured on trials 1 to 4 may 
represent a. simplex (c.f. Chapter 3) ; similarly the intercorrelations 
of the counts of inferred and elaborative relations on trials 1 to 4 may 
also each have this property. Note that the correlations of veridical 
relations with inferred relations and the correlations of inferred with 
elaborative relations appear to vary about zero. The correlations of 
veridical relations with< elaborative relations appear to become negative 
as the trials progress. Empirically, one possibility stated in the two 
questions raised above may be expressed quantitatively by means of the 
mathematical model stated formally in Table 6.2. This model ^supposes 
that (1) counts of veridical relations represent the results of a process 
of semantic interpretation (^'encoding process") which is a stochastic 
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/ Table 6.2 

Summary of Model for Veridical, Inferred, and 
* Elaborative Relations: Hierarchical Additive Encoding, 
Inference, and Elaborative Production Processes which are 

Nonstationary' Markov Simplex Growth Processes 



Structural Model (a)'^ 



I ' ^+ij = Vij 

r 

; Assumptions (b)// 

/ _ 
1* Scaling Assumptions 

II NjE(G^.) = I N^E(>^) = E N.E(E^.) = E(e:^^,^) = E(s^J = 0^ 
var(f7^j) = var(I^ J - var(E^_|) = 1 

.2. Quasi-Simplex Model: Encoding 

var(G^j) = 4>^ = 1 - = 1 - var(£^^) ' 

var(G) = r^^) = D^^) T ^^^^^ T'D^ > + 'F^ 
where $ 

D^^^^ is a diagonal matrix containing K^^^ = aj^^a$^\ . . a^^^ 
s t 1 2 ' t 



* i = 1,2,3, (response class); i' = 2,3;i'' = 3; t - 1, . . 4(trials); 
j = 1>2 (group) 

# For maximum likelihood estimation, it is assumed in addition that X is 
distributed multinormal with mean vector and covariance matrix"^!, 

(Note,, a lower case letter underlined indicates a column vector.) 

EKLC 



Table 6*2 (continued) 
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*T is a lower triangular matrix of ones. 

(G) 2 
$ contains ^ ~ diagonal matrix) 

2 2 
f is a diagonal matrix containing 

G' » (G^, G^, G^, G^) 



3. Simplex Model: Inference 

var(I) = r^^^ = D^^^^T T'D<^) 



Where D^"^^ is a diagonal matrix containing *^l^^^2' 
!■= (I^. I^-, I3. V. and ^ Df) ^ 



a 



(I) 



A. Simplex Model: Elaborative Production 



var 



(E) - r(E> = Df )t T- D^E) as in (3.) 



5. Additive Hierarchical Model 

.2 



where 



B = 



2 
3 
4 

5 

6 

7 
8 
9 

10 



ERIC 



E = var (X) « BFB' + 0 



^1 ^2 ^3 ^ 



^1 h ^3 



,(G) 
11 



,(G) 
21 



,(G) 
31 



,(G) 
^41 



,(G) 
12 



(G) 
•'22 



,(G) 
32 



42 



11 3 
12 
13 
14 
15 



(G) 
13 



,(G) 
23 



j(G) 
33 



^43 



.(I) 
^12 



22 



32 



42 



13 



^23 



33 



*43 



■^1 h h \ 



,(E) 
13 



^23 



,(E) 
'33 



'reminiscence 
trials 
5 JL0_15 



^43 



(blanks are zeros) 
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Table 6.2 (continued) 



6. Assumption of Independent Processes 



r ,= 



,(E) 



cov(G, X^) 



GOV 



(I. V 



cov (E, X^) 



var 



(A Symmetric Matrix) 



2 2 
0 is a diagonal matrix containing 0 . 

ti 

X is a vector of response class frequencies ordered as in Table 4, 
-'r ^ ^^5' ^15^ * - ^ 
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growth process (more explicitly a nons tationary Markov process with 
continuous states), (2) counts of inferred relations reflect a linear 
combination of the results of the encoding process and a process of 
inference which is a stochastic growth process independent of encoding, 
and (3) that counts of elaborative relations reflect a linear combina- 
tion of the results of encoding, inference, and an elaborative process 
which is a stochastic growth process independent of encoding and 
inference. The fifth *'raminiscence" trial measures are treated as 
"extension" variables: I.e., their correlations with the latent variables 
encoding, inference, and elaborative production are estimated as a part 
of the model. The first equation in Table 6.2 states that the frequency 
of response class i on trial t for context j is equal to the mean for 
that measure-trial combination (M plus linear regression on encoding 
at trial t for context j (G ) plus (for inferred and elaborative 
relations) linear regress-ion"^ on inference at trial t for context j (Itj) 
plus (solely for elaborative relations) linear regression on elaborative 
production at trial t for context j (E^j)* The last term of this 
equation (Cti'j) represents a measure-specific error component. The 
next three equations of the structural model represent the growth property 
defined respectively for encoding, inference, and elaborative production. 
The remaining equations express assumptions which are necessary to 
completely specify the model including (1) arbitrary scaling assumptions, 
(2)-(4) assumptions defining the simplex growth models, and (5) assump-- 
cions whicl}^ complete the defind.tion of the additive hierarchical model 
described above* 

The above model. Model IV, is one of four models fit to the correlation 
matrix of Table 6.1 each of which reflects different assumptions about 
the processes underlying the observed data. As does Model IV, Models I 
and II both assume that all three response classes reflect an encoding 
process which is stochastically increasing. However, unlike Model IV, 
Models I and II both assume (1) that the observed counts of inferred and 
elaborative relations (additively) reflect inferential or elaborative 
processes respectively in addition to the encoding process, and (2) 
that neither of these processes has stochastic growth properties » Models 
I and II differ with regard to the assumed dependence (Model I) or 
independence (Model II) of the constituent encoding, inferential, and 
elaborative processes. Model III is similar to Model IV but does not 
a?. low for inferred elements to enter into counts of elaborative rela*- 
tions. Models I and II are similar to Model III in this respect. In 
summary: Model I assumes an encoding process which is stochastic, 
inferred and elaborative piocesses which are stationary Spearman cases" 
(i^e. growth in inferred and elaborative relations is due solely to 
growth in the encoded structure), and all processes are dependent; 
Model II is identical to Model I except all processes are independent; 
and Models III knd IV assume independent stochastic growth processes 
associated with encoding, inference, and elaborative production respec- 
tively. 
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6.3 Do Generative Processes Occur at Input? 

It remains to explain the relationship of each of these models to the^. 
question, ''Do generative processes occur, at input?*' Thus, it is necessary 
to derive a connection between the mode of processing at the input of a 
discourse and the dependence properties of the measures as expressed in 
Models I to IV . First, consider the case of a "generative processor .'' 
If the language comprehendev behaves as a "generative processor/' 
generative (e.g., inferential) processes wi'^ 1 occur during^ input ^ 
resulting in a semantic structure in long term memory which contains 
both veridical and subject-generated elements. Thus, if we assume that 
the acquisition of new information occurs at input, then it is reasonable 
to expe.ct that subject-generated (inferred and elaborative) semantic 
elements (as well as reproduced (veridical) elements) should exhibit 
stochastic growth prop'^.rties , and that the observed growth in subject- 
generated elements s ..uld noc be due oolely to growth in the reproduced 
structure. Models III and IV represent this outcome. If, on the other 
hand, the person behaves as an "interpretive processor," generative 
processes will occur .only at output either as retrieval processes or as 
operations on retrieved information. Under such circumstances, and with 
limited time at output, observed growth in subj ec t-gener j.ted semantic 
elements ought to be attributable solely to growth in the reproduced 
structure which was acquired at input. Models I and II express this 
situation. 



6.4 Results 



Each of the four models v/as fit to the correlation matrix of Table 6.1 
using Joreskog's (1970b) program to obtain maximum likelihood estimates 
of all free parameters. The results for Models I-Iv are presented in 
Tables 6.3-6*6 respectively. In terms of goodness-of-f it of the 
alternative simplex models, the results are as follows: 



Model 



EKLC 



II 



III 



IV 



(a 
(b 

(c 
(a 
(c 
(a 
(b 

(c 
(a 
(d 



X 

79*53 



Assumptions 

stochastic encoding process 

inference and elaborative 
production Spearman cases 

dependent processes 

and (b) as above • 

independent processes 

as above 

inference and elaborative 
production stochastic/ 

as above 

f (b) , and (c) as above 43.68 

inference contributes to 
counts of elaborative relations 



90.20 



54.23 



d.f , 

58 



67 



43 



39 



P 

.032 



,031 



.117 



,279 



136 



Table 6.3 

Veridical, Inferred, and Elaborative Relations 
Parameter Estimates for Model I (a) 



Trial Measure 



1 

2 
3 
4 
1 
2 
3 
4 

1 

2 
3 
4 



Veridical Relations 

ri fi 
i( fi 

" . »' 

Inferred Relations 

»t rr 
" fi 

Elaborative Relations 

n CI 
It II 
It II 



^ti 


"^ti 


'^tl 


a 

t 






1 . 0.00* 






.941 


.319 


.000* 


1 . 000* 






.749 


.126 


.000* 


1 . 000* 






.815 


.162 


.000* 


1.000* 






.938 


.033 


.000* 


.244 


.548 








.807 


-.057 


.568" 








.829 


-.040 


.777 








.637 


-.286 


.686 








.720 


.074 




O 

t > 






.795 


-.160 




.698 






.645 


-.134 




.554 






.794 


-.280 




.443 






.804 



denotes parameter values specified by the model 
«= 79.5344; d.f. = 58 , p = .032 

Intercorrelations of Derived Measures (b) 

Derived Measure 



Derived Measure 



Encoding, trial 1 (Gl) 1. 

Encoding, trial 2 (G2) .663 1. 

Encoding, trial 3 (03) .540 .789 1. 

Encoding, trial 4 (G4) .506 .740 .863 

Inferential Production (I) -.043 .182 .156 

Elaborative Production (E) -.339 -.322 -.312 



1. 

.183 
-.307 



1. 

-.011 



Intercorrelations of Derived Measures with Measures Obtained one .Week Later (c) 
Measure aanr.r 



Veridical Relations' 
Inferred Relations 
Elaborative Relations 



.451 
-.058 
-.246 



.694 
.038 
-.335 



.820 
.040 
-.314 



.823 
-.021 
-.380 



.136 
.663 
-.024 



-."50 
.146 
.517 



i 
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Tabla 6.4 

Veridical, Inferred, and Elaborative Relations 
Parameter Estimates for Model II (a) 



Trial 


Measure 


^i 


^i 


^i 


a 

t 




^1 


1 


Veridical Relations 


1.-* 






.942 


.316 


.0* 


2 


11 II 


1.-* 






.748 


.126. 


.0* 


3 


II II 


1.-* 






.816 


.162 


.0* 


4 


II lb 








.938 


.033 


.0* 


1 


Inferred Relations 


.264 


.533 








.816 


2 


ti II 


.006 


.568 








.822 


3 


It 11 


.049 


.771 








.630 


4 


II II 


-.206 


.669 








.724 


1 


Elaborative Relations 


-.074 




.554 






.824 


2 


II II 


-.329 




.600 






.704 


3 


ir II 


-.259 




.573 






.762 


4 


II II 


-.377 




.467 






.780 



denotes parameter values specified by the model 
x2 - 90.1972, d.f. - 67, p « .031 



Intercorrelations of Derived Measures (b) 

Simple Production (Encoding) Process 



Trial 12 3 4 



1 


1.- 








2 


.663 


1.- 






3 


.541 


.790 


1.- 




4 


.507 


.741 


.863 


1.- 



Intercorrelations of Derived Measures with Measures Obtained one Week Later (c) 



Measure: 


=1 








I 


E 


Veridical Relations 


,451 


.697 


.821 


.823 


-.018 


.009 


Inferred Relations 


.022 


.018 


.040 


-.034 


.670 


.133 


Elaborative Relations 


-.204 


-.318 


-.304 


-.366 


.045 


..450 



ERIC 
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Table 6.5 

Veridical, Inferred, and Elaborative Relations 
Parameter Estimates for Model III (a) 



Trial 


Measure 


^i 


ft (I) 


^i 


"t 






1 


Veridical Relations 


1.-* 






.943 


.315 


.0* 


2 


II II ■ 


1.-* 






.746 


.128 


.0* 


3 


II • II 


1.-* 






.815 


.162 


.0* 


4 


II II 


1.-* 






.938 


.033 


.0* 


1 


Inferred Relations 


.240 


.673 




1.-* 




.712 


2 


II II 


-.018 


.743 




.767 




.671 


3 


II It 


.051 


.925 




.751 




.377 


4 


H II 


-.192 


.674 




.879 




.721 


1 


Elaborative Relations 


-.043 




.592 


1.-* 




.801 


2 


II II 


-.323 




.803 


.986 




.461 


3 


II II 


-.293 




.686 


.556 




.664 


4 


It II 


-.394 




.606 


.896 




.678 



* 

'I denotes parameter values specified by the model 
i x2 = 54.2299, d.f. « 43, p - .117 

Intercorrelations of Derived Measures (b) 

Simple Production (Encoding) Process 



EKLC 



Trial 


1 


2 


3 4 


1 (cp 


1.- 






2 (G2) 


. 663 


1 - 




3 (G3) 


.541 


.788 


1.- 


4 (G^) 


.507 


.739 


.863 1.- 






Inferential 


Production Process 


Trial 


1 


2 


3 4 


1 


1.- 






2 (I2) 


.767 


1.-. 




3 (I3) 


.576 


.751 


.1.- 


^ (l4> 


.506 


.660 


.811 1.- 
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Table 6,5 (continued) 
Elaborative Production Process 



Trial 


1 


2 


3 4 


l(E^) 


1.- 






2 (E^) 


.986 


L- 




3 (E3) 


.548 


• .556 






M 


m 


.896 



. / 

■ / 



Intercorrelations of Derived Measures with Measures Obtained one Week later (c) 
Measure G I T i t f r r r 

Veridical ,453 .683 .821 .821 .073 -.048 -.001 -.071 .017 .049 -.034 -. 
Relations 

Inferred .035 ,002 .039 -.038 .640 .422 .536 .696 .157 .086 .001 . 
Relations 

Elaborative -.217 -.307 -.320 -.380 .234 .003 .004 .039 .348 .197 .521 
Relations' 
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Table 6.6 

Veridical, Inferred, and Elaborative Relations 

Ij. V .::v.-^£i ^ er Estimates for Model IV (a) 





Measure 


3 (G) 
ti 


3 

ti 


ti a^. 


^t 


9ti 


1 


^/^erldlcal Relations 


1 . 000* 




.942 


.315 


.0* 




(( It 


1 . 000* 




.Ihl 


.127. 


.0* 


3 


(1 II 


1.000* 




.816 


-.162 


.0* 


4 


II If 


1.000* 




.938 


.032 


.0* 


1 


Inferred Relations 


. 242 


.571 


1.000* 




.795 




ri If 


-.009 


.714 


.896 




.700 




11 II 


.056 


.913 


.792 




.402 


4 


II II 


-.101 


.985 


.603 




.000 


1 


Elaborative Relations 


-.02': 


.211 


.679 1.000* 




.697 


2 


II It 


-.306 


-.048 


.762 .923 




.525 


3 


M II 


-.28-^ 


-.113 


.677 .5ab 




,665 




M II 


-.383 


-.197 


.636 .899 




.638 



denotes parameter values specified by the model 
= 43.6835, d.f. = 39, p - .279 

Intercorrelatlons of Derived Measures (b) 

Simple Production (Encoding) Process 
Trial 1 2 3 i 



1 


1. 




2 


.663 1. 




3 


.541 .789 


1. 


4 


.507 .740 


.863 1. 




Inferential Production Process 


Trial 


1 2 


3 4 


1 


1. 




2 


.896 1. 




3 


.709 .792 


1. 


4 


.427 .477 ■ 


.603 1. 




Elaborative Production Process 


Trial 


1 2 


3 4 


1 


1. 




2 


.923 1. 




3 


.540 .586 


1. 


4 


.486 .527 


.899 1. 
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Comparing Models I and II, it appears reasonable to regard th^ ^ror'^sses 
of encoding, inference, and elaborative production ...b i..^t::i.endent * 
Among the- four models, Mod. IV clearly has the best fit. Thus it is 
reasonable to regard the three processes as independent stochastic 
growth processes. In the first three columns of Table 6.6 (a) are . ^ 
estimates of the regression weights for encoding (3^^^)> inference (3^^ ), 
and elaborative production i^^^^) for each response class for each 
trial. Observe that for counts of inferred relations the veights on 
simple encoding decrease'^ while weights on inference increase vith trials* 
Similarly, for counts of elaborative relations the rej^ressi .n \.<--' 
encoding become negative, th-^'-^e on fer^^ce •/ ^ ea^se ith recj 
expc^ure to the t *' , r :id ^ .i . its c el orativa produucxuii i.^crease on 
Li ial two and theu decrease o: . subse quent trials. The numbers in column 
four reflect the rate of growth of encoding, inference, and elaborative 
production • The correlations of Table 6.6 (b) reflect the simplex 
property for encoding, inference, and elaborative production* Table 6.6 
(c) presents the estimated correlations of encoding, inference, and 
elaborative production with counts of veridical, inferred, and elaborative 
relations obtained one week later. Interestingly, counts of veridical 
relations correlate highest (.821) with encoding on the last trial, but 
frequency of inferred relations correlated highest (.775) with inference 
on the first trial. The results would appear to strongly support the 
"generative isemantic" view of comprehension processes and the assumption 
of process independence. 

6-5 Effects of Contexttial Conditions 

In the results just described, stochastic models associated with alter^ 
native process models were compared with regard to their differential 
fit to the observed data. In order to provide a stronger test of the 
ability of the comparative model fitting technique employed here to 
reflect the processes operating in comprehension tasks, the models were 
fit separately to data obtained under each of the two experimental condi- 
tions: (A) the **natural" condition in which subjects were presented with 
ci recorded discourse and then asked to write their reconstruction of 
the information which they had acquired from the dl^^^*^ :rse, and (B) 
the I'problem solving" r-^.ndition in which subjects were also required to 
genera ^e : subsequent use as many different solutions as they could 
to a problem based, on the content of the essay. Recall that the 
solution process required the subject to generate inferences which were 
constrained, i.e., the inferences had to be solution-related. Detailed 
consideration of the probable effects of condition B Xeads to the expec- 
tation that: (1) generative processes including inference should occur 
substantially at input, (2) subject-generated (e.g., inferred) elements 
should be relatively more independent of reproduced (veridical) elements 
than under condition A since they should be s tructurally_tnore distinct, 
and (3) the production of subj ect-genei?ated elements should be essentially 
non-cumulative. Thus, in terms of models fit to the data, the expecta- 
tion was that Model II should fit the data obtained under condition B 
while (if the generative semantic model is valid) Model IV should fit 
the data obtained unde.r condition A. Note that unlike condition A, 
for condition B, Model II should fit even though generative processes 
^"cur at input. 



1A3 



Results concerning mean frequencies of veridical, inferred, and elaborative 
relations indicate that condition B produced significantly mc f: inferred 
relations after the first trial, thar frecuenc s of inferrec re "cions 
increased very- little over trials for elLaer cmr- ^ion, and th-.- nearly 
identical frequencies of veridical re^.£ icns oc rred for ^; - 
conditions. In geneira^. , the ef f e " ? ■ ' ■ jns on u;..^n frequen- 

cies were small. Tl.e -vi.thin grou,. iacercorr ela Lxons for ::he fifteen 
ir.easures for conditions A and B are reported in Tables 6.7 and 6.8 
respectively. Examination of the appropriate submatrices in Table 6.8 
suggests that under condition B, inferred and elaborative responses do 
not have simplex properties. Now consider the "control" conHl^-lor (A). 
Models II and IV were fit to the matrix of Uabl - 7 with t' .i^jwing 
results (see also Table 6.9): 

Chi-square d . f , 2. 
Model II 98.25 67 .008 

Model IV * 52.39 39 .091 

Thus it appears as if Model IV should be selectod r.lthough li.o :;^;SLnnption 
of independent processes is probably not v ^i,;:. other words, it 

appears as if under the "natural'' conditions, subjects behave as genera- 
tive semantic processors. The results for the problem-solving condition 
(B) are summarized in Table 10: Model II fits extremely well (chi-square 
63.61, p = .595, d.f. = 67). Thus while the effec^- of the experimental 
conditions on mean frequencies were modest, the analysis of correlated 
growth results in a dramatic difference entirely consistent with 
theoretical expectations. 

Certain problems occurred in fitting Model "^V to t^:- - :;ion matrix 

of Table 6.7 which should be nor^c . WhJ ^ jie pai. ^jt -^^i appear to 
have been estin^ated accural . iy. jCi^ers .?-.^ear to be rather far from their 
final values. This fact is apparent from observing the correlations of 
the extension variables with latent variables I^ and I2 (Table 6.10 (c)): 
These latter variables have a correlation of one and hence the correla- 
tions of the extension variables with I^ and I2 should be equal. This 
result may be due to some sort of "ridge effect" in the likelihood function. 
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Table 6.9 



Veridical, Inferred, and Elaborative Relations: Model IV 
Fit to Group A Correlation Matrix ^ 



Parameter Estimates for Model (a) 









^ti 


a 








Trial 


Measure 




^i 






L 1 












1 


Veridical Relations 


1.* 






.911 


.376 


.0* 


2 


11 If 


1.* 






- .777 


.000 


.0* 


3 


II J t 


1.* 






.797 . 


.110 


.0* 


4 


If 11 


1.* 






.899 


.041 


.0* 


1 


Inferred Relations 


.125 


.577 




1.* 




.838 


2 




-.089 . 


.902 




1.000 




.465 


3 




' .030 


.978 




.538 




.188 


4 


n If' 


-.134 


1.003 




.654 




.000 


I 


Elaborative Relations 


.143 


.115 


.806 


1.* ' 




.619 


2 


11 11 


-.216 • 


-.105 


.942 


.794 




.000 


3 


II If 


-.461 


-.182 


.583 


.666 




, .610 
.655 


4 


II f 1 


-.418 


-.367 


.555 


.902 





denotes parameter values specified by the inodel 
x2 = 52:3923^ d.f. = 40, p = .091 



Intercorrelations of Derived Measures (b) 

Simple Production (Encoding) Process 



Trial 


1 


2 


3 4 




1 (G^) 


1; 








2 (G^) 


, .645 


■ 1. 






3 (G3) 


.514 




I. ' 






.462 


' .716 


.865 1. ■ - 








Inferential 


Production Process 


c 


Trial 


1 


2 


3 4 






1. 








2 (I2) 


i.obo 


1. 






3 (I3) 


.538 


.538 


1. • ■ . . 




4 (L^) 


.352 


.352 


.654 1. ■ 
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Table 6.9 (continued) ; 

/ 



Trial 


1 ^ 




2 


3 




4 










1, 


















2 (E^) 


.794 


















3 (E3) 


.529 




.666 


1. 












4 (E^) 


.477 




.601 


.902 


1. 








Intercorrelations 0: 


1 Derived Measures 


with 


Measures Obtained 


One Week Later (c) 




Measure 


^1 






^4 


h 


h 


^3 ^4 


^1 h h 


h 


Ver idical 




















Relations 


.520 


,704 


.834 


.746 


.099 


.071 , 


.037 .027 


.052 .084 .016 


-.104 


Inferred 




















Relations 


-.069 - 


-.051 


.054 


-.053 


.640 


.493 


.584 .582 


.253 .064 .054 


.304 



Elaborative 

Relations -.308 -.377 -.348 -.292 .361 .024 -.080 -.013 .285 .140 .419 .261 
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Table 6.10 

Veridical, Inferred, and Elaborative Relations: Model II 
Fit to Group B Correlation Matrix 

Parameter Estimates for Model II (a) 



Trial 


Measure 


B 

ti 




n (E) 


t 




ti 


1 


Veridical Relations 


1.* ■ 






.982 


.186 


^* 


2 


II It 








.733 


.125 


.0* 


3 




1.* 






.814 


.179 


.0*. 


4 




1.* 






.958 


.027 


.0* 


1 


Inferreci R'^ Nations 


.304 


.625 








.708 


2 




.01.-) 


.575 








.815 


3 




.092 


.738 




) 




.657 


h 


U 11 


-.256 


.620 








.755 


1 


Elaborative Relations 


-.222 




.412 






.872 


2 


II II 


-.415 




.334 






.827 


3 


n It 


-.135 




.765 






.642 - 


A 


M II 


-.365 




.574 






.711 



denotes parameter values specified by the model 
= 63.6132,'d.f , - 67, p = .595 

Intercmrrelations of Derived Measures (b) 

Derived Measure 



Derived Measure 




=2 


=3 


"=4 






Encoding, tr. T {Q^) 


1. 




\ 








Encoding, tr. 2 (G^) 


.707 


.1. 










Encoding, tr. 3 (G^) 


.576 


.790 


1. 








Encoding, tr. 4 (G^) 


.552 


.757 


.869 








Intercorrelations of 


Derived Measures with 


Measures 


Obtained 


one Week 


Later (c) 










^4 


I 


E 


Veridical Relations 
Inferred Relations 
Elaborative Relations 


.478 
.082 
-.202 


.689 
.038 
-.286 


.816 
.012 
-.295 


.883 
.003 
-.438 


-.076 
.570 
.110 


.023 
.038 
.519 



CHAPTER 7 



. SOURCES OF INDIVIDUAL DIFFERENCES IN COMPREHENSION 

4^ AHD SEMANTIC MEMORY 



7 . 1 Introduction 

The questions which have been investigated thus far have been con- 
cerned with identifying characteristics of information processing 
activities in the acquisition of semantic knowledge from discourse 
under 'normal" contextual coaditions (including limits on processing 
capacity and adjustments to limits on processing through processes 
of^sLmplication and generative inference), and with investigating 
effects of r'ipeated exposures and contextual conditions on these 
processes by studying their effects on semantic information which is 
acquired from a text. A question of particular interest h^s been 
the extent to which generative processing activities occv ind the 
\ role of these processes in discourse comprehension and semantic memory. 
\The results obtained were found to be consistent with a generative 
processing model and indicate not only that generative processes occur 
during the time in which a discourse, is input, but that the nature 
of these processing activities (and hence the nature of the semantic 
information acquired from a discourse) may be influenced by contex- 
cual conditions which induce further processing of the semantic 
Information once it has been acquired. If, in fact, the conception 
ot discourse comprehension and semantic memory as a hierarchiacally 
organized multi-level sequence of processing operations with genera- 
^tive operations occurring at the top (cf . Figure 4.2) is correct; 
and if the extent of generative processing is affected by properties 
^of a discourse and contextual conditions; it is also reasonable to 
expect that individuals will differ in the extent to which they 
process texts interppetively or generatlvely . Thus as information 
processing activities in normal comprehension and semantic memory are 
understood, possible sources of individual differences in these 
processing activities may be Identified. Once potential sources of 
individual differences have been Identified, it may be possible to 
o|5tain m^asuYements of differences in these processing activities 
One possible set of measures are those used In the present study: ' 
relative frequencies of particular classes of semantic information 
in Individuals' recall protocols-. Thus relative frequencies of 
subject-generated semantic relations may provide reliable measures 
of the extent to which an Individual processes semantic information 
generatlvely. Such measurements, may eventually be useful in practi- 
cal situations, e.g. in diagnosing sources of difficulties in oral 
and written comprehension. For example, if a child should consis- 
tently show an unusually low frequency of inferred seir.antic elements 
in protocols obtained in a "st^ry retelling" task, this would indi- 
cate a failure to (proces? discourse inputs generatlvely and thus 
identify the soared of his difficulty In comprehending school 
materials. / 

! { 
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In any task involving a sequence of processing operations, ^differences^ 
between individuals can occur both qualitative and quantitative: ) \ 
Qualitative differences can occur if individuals differ in the particu-\V 
lar sequence of processing operations which they . employ • Thus, in 
terms of the model summarized in Figures A,l-4.3, individuals may di^:^•^/r 
in the particular elements processed at each level: in terms of, boch 
types and size of elements segmented or selected; and they may differ 
in the sequence of processing operations which they employ: in the 
extent of processing at each level and in constituent processes at 
3ach level. Qualitative differences would also appear to be likely 
as a result of differences in the availability of previously acquired 
semantic information stored in long term memory. Quantitative differ- 
ences may occur if individuals diff er . with respect to the relative 
efficiency of any constituent processing operations, or in the efficiency 
with which constituent operations are combined. Such quantitative 
differences would be expected to produce differences in measures of 
comprehension, even if no qualitative differences occurred among 
Individuals, i.e., even if each individual processed a discourse in 
exactly t^e same manner. This distinction between qualitative and 
quantitative sources of individual differences might be described as 
a distinction between individual diff erenc.es related to mode of processing 
and to the efficiency of processing. For example, surface or syntactic 
characteristics may be prdcessed more extensively by some people when 
processing discourse, while others may pay more attention to semantic 
distinctions. Once a processing strategy is chosen, the .efficiency 
variable refers to differences in the knowledge or skill needed to 
use that strategy in a comp^etent manner. For a person who chose to 
process the surface and syntactic infortotion, a good knowledge of 
grammar and Interpretive rules would be necessary to process efficiently, 
whereas for a generative (semantic) processoi;an ability to make pre- 
viously stored semantic information available and to efficiently gener- 
ate and evaluate plausible semantic interpretations would be needed 
for efficient comprehension. In the present chapter, both quantita'- 
tive and qualitative sources of individual differences will be examined. 

While most studies of individual differences in language comprehension 
have tended to focus on outcomes, measuring comprehension on various 
tasks designed to assess level of proficiency on different comprehen- 
sion skills (such as recalling word meanings, drawing inferences about 
the meaning of words from context; finding answers to questions where 
the answer was stated in the text; drawing inferences; following the 
structure of the passage; recognizing the writer's purpose, etc., 
cf. Davis, 1968), the focus in the present study is on specific out- 
comes, qualitative and quantitative differences in the sequence of 
processing operations which generate these outcomes, and on effects of 
properties of a discourse and of contextual conditions on these differ- 
ences. This chapter will consider first sources of individual differ- 
ences related to the efficiency of various constituent processes in 
language comprehension and «€>mantic memory:^ The method adopted will 
be to obtain measures of specific narrowly defined '"abilities" to 
estimate a subject's probable level of efficiency with respect to 
various constituent operations in processing discourse and to study 
predictive relationships between these measures and measures obtained 
from the analysis of subjects' recall protocols. High correlations 
with a particular ability measure would be expected to result if: 
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(1) the constituent processes related to the ability occurred as a 
part of the sequence of processing activities for most or all of the 
subjects, and (2) the relacive efficiency of these processes has an 
effect on the extent to which particular semantic information is 
acquired. Suppose, for example, that a non-verbal measure of inferential 

reasoning ''ability** were available which measured the efficiency 

with which an individual is ablvi to i nf erentially generate and evaluate 
semantic information. To the extent that inferential processes are 
a part of discourse processing in all subjects, and to the extent that 
efficient inferential processing results in the acquisition of 
semantic information, the ability measure should be capable of pre- 
dicting semantic measures obtained from subjects^ recall protocols. 
Furthermore, the magnitude of this correlation should be affected by 
the same contextual factors which were previously found to affect the 
extent of inferential operations in processing discourse. Thus, as 
in Chapter 5, we will be interested in both (1) the magnitudes of 
individual ability-response class correlations ii "normal'* comprehen- 
sion (condition A) , and (2) experimentally-induced differences in 
ability-response class correlations. The rationale, underlying this 
approach Involves interpreting a high correlation between a specific 
ability measure and response class as indicative of the particular \ 
process or processes involved in generating responses of that clacks ' 
(cf. Fredeiriksen, 1969). Since . this rationale depends on the notlou 
ofj-shared processes, processes shared between the ability measure and 
the' response class, it is Important to establish that the two measures 
have in common only the process which is of interest* Thus, a correla- 
tion of a verbal reasoning measure and frequencies of inferred relations 
could reflect many common processes other than reasoning operations 
since the ability test is itself a measure of comprehension. It should 
now be. clear how a carefully designed study of individual differences 
in processing efficiency can provide valuable information concerning 
normative processing events in comprehension and semantic memory. 

The remaining sections of this chapter v/ill focus on qualitative 
differences among individuals — on possible differences in strategies 
used to select semantic information for further processing and long 
term storage; to retrieve information from memory (including selection 
of entry points to semantic structures in LTM, organizational pro- 
cesses,- and directed search strategies); and to generate new semantic 
information from information which has been acquired from a discourse 
or retrieved from LTM. Questions to be asked concerning qualitative 
sources of individual differences" include : (1) deteirmining whether 
reliable differences among Individuals occur under condition s of 
'* normal'' comprehension, (2) investigating effects of contextual con- 
ditions on strategy selection, and (3) attempting to identify com- 
binations of. strategy statements which define integrated processing 
strategies which include strategies for selection, organization, 
generative operations, and retrieval strategies. This latter question 
will -be studied by analyzing matrices of intercorrela tions of strategy 
measures obtained under each condition by attempting to find a simple 
linear factor model involving a small number of factors from which the 
correlation matrix can be reproduced. " Since information processing 
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Strategies Identified in this way are obtained from analyses of 
strategy- intercorrelations , any such strategy factors by definition 
represent qualitative sources of individual differences. 

1.1 Cognitive Abilities and . Processing Operations in Discourse Com- - 
prehension and Semantic Memory 

The approach to the study of individual differences in comprehension 
and memory processes to be described in this section involves attempting 
to predict frequencies of classes of semantic elements on subjects' 
protocols from measurements of abilities related to specific processes 
which may be involved in generating these elements, and studying the 
effects of contextual conditions on these predictive relationships. 
For purposes of selecting and classifying ability measures,, constitu- 
ent processes in comprehension and memory were classified into inter- 
pretive processes, unconstrained, generative processes (associated with 
elaboration), generative inference, output express ional processes, 
storage and retrieval processes, processes associated with buffer 
storage, and processes associated with the identification and mainten- 
ance of Semantic elements. Ability measurements related to each of 
these classes were obtained and used to predict response class 
frequencies separately for each experimental context. Fifteen tests 
were originally selected (see Chapter 5), but only twelve tests were 
proved to have sufficiently high sample reliabilities to be included 
in subsequent analyses (Table 7.1). The tests retained have been 
found to measure the following cognitive abilities (cf. French, Ekstrom, 
& Price, 1963): 

Closure : 1. Cf (Flexibility of closure): Maintenance 

of a visual pattern in a distracting 
visual field (Hidden Patterns Test) 
2. Cs (Speed of closure): Speed of identifica- 
tion . of a visual pattern in which 
a distracting pattern interrupts contours 
(Gestalt Completion Test) 

Fluency : . 1. Fe (Expressional fluency) : Facility in 

producing connected discourse that 
will fit restrictions imposed in terms 
of given ideas (Word Arrangement Test) 

2. Fi (Ideational Fluency): Facility in 

producing quantities of verbally ex- 
pressed ideas (Themes, score is number 
of words' written; Topics, score is 
/number of phrases or sentences written). 

3. Fa (Associational Fluency): Constrained 

associative production of a single word 
(Controlled Associations) 

Reasoning : 1. Rs (Syllogistic Reasoning): Application 

of rules of deductive logic to evalu- 
ate propositions. (Inference Test) 
2. I (Induction): Generation and evaluation 
of rules from examples to eliminate one 
set of several sets of letters (Letter 
Sets) 
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(Memory Span): Length of a string 
of letters which can be loaintained 
briefly in an auditory rehearsal 
buffer (Auditory Letter Span) 
(Associative Memory) : Paired-associate 
learning (First and. Last Names Test) 

Size of comprehension vocabulary 

The matrix of intercbrrelations of these twelve ability tests is 
presented in Table 7.1. The relationship of each of these abilities to , 
the classes of constituent processes is as follows: interpretive 
processes: Vocabulary (interpretation of lexical elements); 
unconstrained generative processes: ideatioTial fluency; inferential 
processes: reasoning; output expressional processes: expressional 
fluency; buffer storage: memory span; processes associated with the 
identification and maintenance of a structural element: the closure 
factors* Since it appeared as if, of the fluency tests, "Themes" and 
"Topics" might measure expressional fluency as well as ideational 
fluency (i.e.. since scores reflect amount written); and since it was 
desired to obtain a single measure of reasoning which did not involve 
verbal comprehension, the matrix of intercorrela tions of these tests 
was analyzed by fitting alternative linear factor models to the matrix 
until that model was found which best fit the correlation matrix. 
The model is summarized in Table 7.2 and differs from the familiar 
linear factor model only with respect to the treatment of a subset of 
the tests as^ extension variables (variables which are not included 
in the analysis except to estimate their correlations with the factors 
which were fit to the subset of tests which were analyzed). Maximum 
likelihood estimates of all free parameters were obtained using 
Joreskog's (1970) estimation program and the fit of the model of 
Table 7.3 was found to be excellent (x^(35) = 20.2498, p = .978). 
Note that, just as in Chapter 6, small value of chi-square and large p 
values indicate that the fit of the model to the data is good. 
Parameter estimates obtained for the resulting best-fitting model are 
presented in Table 7.3. Four factors were found: (1) an ideational 
fluency factor measured by Topics, Word Arrangement, and Controlled 
Associations, (2) an expressional fluency factor measured by Topics, 
Themes, and Word Arrangement, (3) the expected reasoning factor, 
and (4) a closure factor measured by Four-Letter Words and Letter 
Sefts. Both of these latter two tests involve recognizing a letter 
pattern embedded in a. larger sequence. The intercorrelations of these 
factors are given in Table 7.3b. Reasoning is uncorrelated with 
expressional fluency and also has very little correlation with verbal 
closure. Correlation^ :of the extension variables with the four 
factors are found in Tabl^ 7.3c. In general, the measures appear to 
be rather independent of 'each other. J 

o 

Results obtained concerning the predictive relationships of .the four 
ability factors and five extension variables with frequencies of 
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Table 7.2 

Summary of Model Fit 1:0 Matrix of Intercorrelations 

of Ability Tests 



Assumptions ; Linear Factor Model 

(1) = A X + where ^ = random vector of p test scores 

A - matrix of regression weights 
X ~ random vector of factor scores 

(2) var(2) = Z = A .$ A' + 

(3) var(x) = $ (a correlation matrix) 

(4) var(z^) = (a diagonal matrix) 

(5) E(x) = E(z) = 0 



Assumptions : Linear Factor Model with Extension Variables 



letx = 



(6) 



12 

hi 
hi 



where 



2^ ~ a random vector of scores on p^^ tests to be 
factored 

' ^2 ~ ^ random vector of P2 extension variables 



12 



^22 



A, 



0 



0 
I 



_^11_[_\2 
^"2 I ^22 



a; I 0 

V ! V 



^2 I 0 

0 I 0 



then ~ cov{x> » correlations of the extension variables 

with the factors , • 

,-,2 



(7) l^^ Ai.$iiA^ + ^^' 



(8). = ^ ^12 -> 



12 



12 
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veridical, ovexgenetalized, pseudodiscriminated , inferred, and 
elaborative secrantic relations will now be presented. The results 
will be presented pertaining ,, to each of the six classes of processing 
operations or processor characteristics in comprehension and semantic 
memory: (1) generative inference, (2) unconstrained generative 

.processes, (3) expressional processes, (4) processes associated with 
the identification and maintenance of structural information, (5) 
■processes involved in the memory system (including buffer capacity), 
and (6) relative size -of the comprehension- vocabulary (i.e. numbef^t:^ 
of lexical elements for which accurate semantic information can be 
- retrieved from mempry) . In examining the results which .follow, it 
is important to realize that of the set of semantic relations con- 
sidered, Veridical and overgeneralized semantic relations do not 
reflect subject-generated semantic elements; pseudodiscriminated, 
inferred, and elaborative semantic relations all involve subject- 
generated elements in some way. The latter three response classes 
differ with respect to the manner qnd extent to which generated 
semantic information is* constrained , e.g. by the discourse or by par- 
-ticular derivational rules such as rules of inference. The inter-\ 
correlations of the above response measures obtained under condition A 

^were reported in Table 3,2; intercorrelations of frequencies of classes 
of semantic relations obtained from subjects' protocols under condi-. 

. tions B and C are reported in Tables 7.4 and 7.5 respectively. 

.Correlations of these classes of semantic responses with the nine 
"efficiency*/ variables (four factors and five extension tests) for 
each of the three experimental con^ii tions are reported in Tables 7.6, 
7.7, and 7.8. 

Consider first the results concerning inferential processes (factor 
Rs) . The ■ two tests which were Selected as measures of reasoning 
ability: Inference (the test items involve selecting correct con- 
clusions which can be drawn from given statements) and Letter Sets 
(the task involves finding *a ruje which related sets of four letters 
and eliminating a fif tli set of letters whicji does not fit the rule) 
both involve a* requirement that -.the sub'ject'^e able to generate and 
evaluate inferences. / Recall t;^at the procedure used was to 'estimate 
the fadtor common to the two tests and use this inferential reasoning 
factor to p?^dict response^nieasures . This factor by definition will 
be independent of verbal factors since only one of the tests it^volves 
verbal content. Thus correlations of response measures with this 
estimated reasoning fadtor are not due to common verbal content. 
Correlations^of reasoning- ability with frequencies of veridical, 
inferred, and' elaborative relations are found in column 3, Table 7.6, 
7.7, and 7.8. A number of results are apparent: (1) frequencies of 
veridical relations are predictable from reasoning for all contexts; 
(2) -^'.th only one exposure to the passage, reasoning correlates highest 
with .veridical relations for condition B, but the correlation for 
condition A increases with repeated exposures to the text and sur- 
passes that of condition B; (3) inferred relations are predictable 
from reasoning only under condition B; and (4) reasoning is negatively 
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correlatRd with elaboratlve relations under all .conditions. Since 
it was also shown in Chapter 6 that inferred relations were 
acquired at input, these results would appear to indicate that the 
generation of relational structures (other than those which are 
elaboratlve) in comprehending and remembering a text necessarily 
Involves inferential operations on the semantic content of the text. 
Included in the preceding statement are those relations which were 
explicitly coded in the text. These results also indicate independ- 
ently of the rssults on mean frequencies of response classes, that the 
effect of the contexts was in part to induce generative reasoning 
processes. The low correlations of reasoning with inferred relations 
under condition A deserve some comment. One possible explanation of 
this result is thst the semantic relational information which is 
scored as "inferred'' und^r condition A, is not generated by the same 
sort of '^formal*' operations rs the Information so scored under condi- 
tion B. Thus, Inferred semantic in ^rmation which is generated under 
the ''normal" contextual condition (A) may be '^presupposltional" in 
nature. The zero correlation of reasoning with Inferred relations 
on trial 4 under the Incidental memory condition (C), probably reflects 
the fact that by trial 4, the process of generation of Inferred infor- 
mation is largely complete and the subjects are concentrating on 
retrieving previously stored semantic information. 

The fact that such large positive correlations of measures of compre- 
hension with reasoning were obtained is of extreme interc t. Most 
studies of the relationship of comprehension with abilities have 
employed standard intelligence tests which include verbal comprehen- 
sion* tasks. It appears that very few studies have found relationships 
between reasoning measures and measures of comprehension which cannot 
be explained on the basis of common verbal content. Two studies in 
particular appear to indicate a relationship between reasoning abilities 
and performance on comprehension tests. The first (bpearritt, 1962) 
consisted of a factor analysis of a battery of 34 tests, including 
measures of listening comprehension, reading comprehension, Inductive 
and deductive- ? oasoning, attention, meaningful and rote memory, memory 
span, and the STUP listening test given to 300 sixth graders. He was 
able to identify a factor of "listening comprension" which was posi- 
tively correlated with factors of verbal comprehension, inductive 
reasoning, and memory span. The second study, by Hartootunian (1966) 
at ^.mpted to predict reading achievement (measured by the California 
Achievement Test) from fifteen tests which measured six factors: word 
fluency. Ideational fluency , conceptual foresight, speed of closure, 
flexibility of closure, judgment and evaluation, and one global measure: 
the Calif or.nia Test of Mental Maturity. "Conceptual foresight" was 
measured by t\ jts: Seeing Problems and Missing Facts. The 'latter 
test required ttie subject to see what facts were needed to solV;e 
arithmetic problems. Two other tests, Critical Thinking and Best Answer, 
both measures of the ''judgment and evaluation" factor, required 
(respectively) seeing which inferences ^ com a set were logical and 
choosing best: answers to practical questions reflecting evaluative 
skill. Subjects were 513 seventh and ei^^ath graders from two suburban 
gj^^ools. In predicting reading scores by multiple regression, the 
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highest weights were given to Misaing Facts, to the two measures of 
"judgment and evaluation/' and to one test of word fluency. However, 
the global nature of the comprehension scores used in these studies 
makes interpretation of these findings difficult. The present results 
should serve to illustrate the kind of information which can be 
obtained concerning sources of individual differences when specific' 
well-defined "comprehension" measures are employed. 

«,Result6 pertinent to the effects of diffrrences in efficiency on 
generating semantic information, on the types and amount of acquired 
semantic information are found in column 1 of Tables 7.6-7.8. The 
ideational fluency factor reflects the accessibility of stored seman- 
tic information and the ability to retrieve or generate sejnantic infor- 
mation in situations which vary in the degree to which the generated 
information is constrained by the task. Notice first that the corre- 
lation of this factor with veridical relations Increases with repeated 
exposure to the text for both conditions A and B (with a higher level 
of correlation for condition A).. Apparently, veridical semantic 
relations are required in a relational str^^cture which is gradually 
built up and which includes generated (presuppositional?) structural 
elements such that facility in generating these structural elements 
is related to the amount of veridical semantic information which is 
acquired. There also appears to be a positive relationship of idea- 
tional fluency with frequencieb of overgeneralized semantic r lations, 
the correlations decreasing with repeated exposures to the test (and 
decreasing more under condition A). These positive correlations 
probably reflect the same factors as do uhe positive correlations with 
veridical relations; the decrease probably reflects the fact that there 
^^xs much less growth in" semantic relations involving overgeneralized 
concepts than in veridical semantic relations (cf. Tables 5.2 and 5.6), 
The correlations of ideational fluency with inferred relations de- 
crease" for condition A and are generally small, and insignificant for . 
both conditions (except for. trial 1 and condition A). The differences between 
conditions A and B in the trial 1 correlation 'probably reflects the 
different nature of relations scored as inferred under the two condi- 
tions. Judging from the correlations of the ideational fluency factor 
with frequencies of elaborative semantic relationSp efficiency in 
generating semantic information is important in predicting the extent 
of elaborative Information which is produced only after repeated trials 
under condition B. This, result appears to indicate that the task • 
does not require enough in the way of unconstrained generation ofr 
semantic information to make the -efficiency of these processes a^major 
factor In determining performance.' 

Correlations of the expresslonal fluency ^actor with veridical and 
overgeneralizefi semantic relations are generally positive and signi- 
ficant, especi .ly under conditions B and C and for measure obtained 
on later trials; correlations with subject-generated inferred relations 
(and pseudodlscrimina'Led relations which Include subject-generated 
elements) are also significant on the last trial. Efficiency in 
expressing acquired semantic Information thus appears to be a limiting 
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factor as more inrormation is acquired and for response classes having 
high frequencies of occurrence • The closure factors include measures 
of speed (Cs) and flexibility (Cf) In identifying and mrrlnr.Pining a 
visual pattern, and In identifying letter patterns emb\ \* a 

sequence of letters (Cv) . A31 of these measures involve ^ recog- 
nition of a "figure" contained in an input configuration; Cv is ^nost 
similar to pattern identification in processing discourse since it 
involves letter patterns which are embedded in a sequence (and hence 
involve sequential scanning) • Thus It is not surprising that the 
closure factors are related to the acquisition or veridic?il and over- 
generalized semantic relations. The fact" that this relationship is 
found only under conditions B and' C is presumably related to effects 
of the increased processing load imposed by condirions 3 and C, since 
it is well-known that the difficulty of closure tasks is related to 
the distracting properties of the pattern i;- v/hich a figure is em- 
bedded. 

It remains to consider possible differences In acquired semantic in- 
formation which are related to memory processes and vocabulary 
size. First, the capacity of the rehearsal buffer (as measured by 
auditory, letter spr;;) is generally not an important source of indi- 
vidual dif: arences in acquired' semantic Information. If associative 
memory is taken as a measure of efficiency in rote memory tasks, 
rote memory appears to be important only in the acquisition pf veri- 
dical iniormation on later trials for condition A and for the Incidental 
memory condition. These are just tl.^ conditions which appear most 
likely to produce rote retrieval strategies. Finally, vocabulary 
shows significant correlations, with the acquisition of veridical 
semantic rela.tions under contexts A and B and these are larger under 
condition A. Cont ext— related differences also occurred in predicting 
inferred semantic relations from vocabulary. This last -csult further 
suggests that the "inferred relations" produced under udition A 
were different from the problem-relatcj inferences produced under 
Condition B. Presumably, these relations produced under condition A 
are presuppositions obtained in part from e::panding and operating upon 
word meanings. 

7.3 Effects of Contextual Conditions on Strategy Choice 

Qualitative sources of individual differences in mode of inform^xtion 
processing are the subject of the remaining" two sections of this 
chapter. This section will be concerned with presenting a classifica- 
tion of the strategies studied and with Identifying specif ic-strategy 
statements for which context-induced differences were obtained. The 
r.3Xt section will inquire into the ma^^ ^o.r in which these soer-' "-"ic 
strategies combine in defining major teristic proccv:x.^A 

sequences in discourse comprehension aj. ^semantic melnory - . .al'^ing 
the dependence structures of the strategy measure.s, ConLr\\. i^iaJuced 
dif 'erences in these structures will also be stuc = . v^ :,n gen/-^ra] , if 
specilfic strategies are found to coirbine into inte_pritable ^'process- 
ing sequences", this will constitute evidence for important qualita- 
tive differences among individuals in discourse comprehension. If 
FR?r" ^^^^ ^ ' isult is obtained, then qualitative differe?nces among indi- 
tryjL viduals in a less homogenous population would be expected to be even 
greater, 
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The method used to measure e>:i:ent of use of partj.cular strategies in 

'firing and remembering information presented in a discpurse has 
uiiieady been described in Chapter 5. The method involves presenting 
a subject with a sentence sampled from the discourse and asking the 
subject to indicate which of a set of statements of possible strategies 
apply to describe the strategy he used in acquiring the semantic Infor- 
mation contained in the sentence. Previous experience has shown that, 
in relatively protracted learning tasks subjects can provide reliable 
Information using this^ procedure (where rel3-^bility is assessed by 
obtaining strategy judgments for a set of "target items", obtaining 
pov^led scores for each strategy statement for random halves of the 
it ems, and correlating the resulting part scores (Frederiksen> 1969) • 
The strategy statements presented to the subjects in the present 
study represent three principal categories of information processing 
activiti-s: (1) selection strategies (S> , (2) retrieval strategies 
(R) , and (3) generative operations (G) , The list of strc:tegy state- 
mcxits of ■[^'able 7.9 (and all subsequent tables) identifies which 
categories of processing activities are involved in eacV strategy. 
Selection strategies include: attentional strategies (shifting atten- 
tion and attention to parts), selection of an entire surface sequence 
(rote memory) , semantic selection (particular ideas, unusual ideas), 
and Inferential selection (central ideas, most important ideas). 
Retrieval strategies involve strategies for the retrieval of semantic 
information from a stored semantic network and include: undirected 
search (no particular strategy), directed search (key words by rote, 
central ideas, details, ideas in sequence, reordered, most important 
first and expository order) , and inferential retrieval strategies 
(unstated relationships). Generative operations include: inferential 
processes (classification, pr vious knowledge, unstated relationships) 
and elaborative processes (images, assoc f rions, illustrations, 
elaboration). Three statements refer to ^^aneral characteristics of 
information-processing siErategies: shifted strategies, systematic 
method, and noticed ef ec tiveness . It should be noted that these 
statements re.rer primarily to the sent^ntic memory aspects of the base 
comprehension task, i.e. in operations occurring during recall. The 
reason for this is that processes occurring' during input should not 
be as readily identifiable by the subjects as coherent strategies. 

>'^an numbers of propositions (out of ten) for whic^ subjects indi- 
L "ed that each strategy was employed are presentea in TabJ.^ 7.9 fo^ 
cOi.4 textual conditions .A, B, and C; by seix and pooled over sex. In 
pooled within-group standard deviation may be used as an est.imate of 
the conimon wi thin-group standard deviation of each measure 
place confidence limits on the means. Analyses of variance for each 
strategy measure are summarized in Table 7.10. It is apparent from 
these results that with the e"cepti( n of associations, all .effects 
of the conditions involved retrieval strategies; tsome (but not all) 
of the differences ap Bar to be produced mainly by th^^ incidental 
memory condition. Thus, undirected search stratef;ies are reported 
Q to occur to a much greater extent under the incidental memory 
ER^C while rote strategies (key words by rote, idea? 'n se- 

i^mam qu^mce) occur to a much lesser ^excent under the incidental memory 



condition. Reordering of semantic elements in retrieval was 
reported to occur to a much greater extent under the incidental 
condition. It is interesting that expository ordering was re- 
ported as a strategy, and tb,-n the groups were ordered C<A<B in 
terms of this strategy raea are. Significant differences among cond:. 
tion also occurred with respect to generation of associations in "'the 
same order (C<A<B) * The suggestion is that with respect to some 
memory strategies^ the incidental memory condition is closer to the 
incidental problem solving condition (A). The absence of differ- 
ences ^due to conditions in generation and selection strategies is 
also interesting, suggesting perhaps that these strategies reflect 
more the surface and semantic properties of a discourse than they do 
contextual conditions. Significant sex effect- were observed 
only for undirected retrieval (no particular strategy), the males ^ 
scores exceeding the females' under each condition. No significant 
interact ions of condition with sex were found. 

7,4 S tru e tut. ' Analyses of Strategies 

Intercor relations of the twenty- three ^^trategy statements were com- 
puted separately for each group and ^..^ presented in Tables 7.11- 
7,13 for conditions A-C respectively. Substantial differences in 
these correlations are apparent across the three conditions^ Since 
interpretation of differences in these tables across conditions is 
extremely difficult due to the large numbers of measures, and since 
we want to determine whether individual differences in reported 
strategy usage are such that specific strategies group into inter- 
pretabie characteristic sequences of processing operations, the 
information provided by each of th^se matrices^ concerning the 
dependence structure of the strategy lieasure was analyzed. Each of 
these correlation matrices was anal\ .ed^by fitting a linear factor 
model with extension variables (cf. Table 7.2) to each correlation 
matriji. The technique used to analyze each matrix involved, first, 
obtaining principal components of the correlation matrix and rotating 
the resulting factors using orthogonal varimax. Then small fac- 
tor loadings were fixed to be exactly zero' arid the resulting model 
was fit using Joreskog^s (1970) program to obtain least-squares 
estimates of all parameters. Then the matrix, of residuals was com- 
puted by subtracting the correlations reproduced by the model from 
the sample values. Large residuals were then located by inspectioxi 
and the model was adjusted to obtain a better fit. Least-squares 
estimates of pai meter ^ralues obtained for the best-fitting models 
obtained for each correlation matrir a^-e reported In Tables 7.14- 
7 16 (in conditions A, B, and C res] ctively , These results,, ob- 
tained by exploratory analysis, can be used as structural hypotheses ' 
in subsequent confirmatory studies. Let us now consiJarthe results 
obtained for each contextual cond ^ on in turn, and then compare 
the results across conditions. 

Consider first the narameter values repo. a Table 7.14 for condi- 

tion A. Table 7.14(a) .reports the fa.: tor loadings of the strategy 
[ieasur.es (regression weights of tests on factors) and standard 
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Table 7.10 



Analyses of Variance of Strategy Measures Testing Main Effects of 
Conditious, Sex, and Interaction, Conditions A, B, and C 







Conditions 


Sex 


Intera( 


Strategy Measure 


F 


F 


F 


1. 


No DPrf-frnl^r 












A r\ ^ •4' 


5 . 60* 


.98 


2. 






. 73 


.07 


3. 


Particular -fd'ppQ T^'l 


.23 


.00 


.40 


4. 


Central -inpac ^'RWc:^ 


.35 


.19 


.36 


5 


Dp f,'^ lie ^1? 


1 . JJ 


.35 


.02 


6 


j-utrdts xn secjuence v.i\^ 


TO O n oL- •st* oLi 


,06 


.91 


7 . 




7*53*** 


.08 


.36 


8 . 












First (R) (S) 


. 66 


.88 


.66 


9. 


Unstated Relationships 








(R)(G) 


• oc 




.43 


10. 


Unusual Ideas (S) 


1.30 


.40 


.64 


11. 


Shifted Attention (S) 


.29 


.20 


.01 


12. 


Visual Images (G) 


1.00 


2.12 


.10 


13. 


Shifted Strategies 


2.60 


2.21 


«63 


14. 


Attention to parts (S) 


.13 


1.90 


.02 


15. 


Formed Associations (G) 


3.63* 


.03 


.44 


16. 


Classification (G) 


,20 


i;27 


.91 


17. 


Previous Knowledge (G) 


.85 


3.62 


1.10 


18. 


Illustration (G) 


1.53 


.97 


.22 


19. 


Systematic Method 


1;88 


.62 


.38 


20. 


Noticed Effectiveness 


2.33 


.07 


.40 


21. 


Kote memory (S) 


2.13 


.00 


1.13 


22. 


Elaboration (G) 


1.66 


.10 


1.00 


23. 


Expository order (R) 


2.86 


1.52 


.61 



* 

*** 



= p < .65 
= p < .01 
= p < .001 
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deviations of specific parts of each measure. Note that interpreta- 
tions of the factors obtained using the present model-fitting method 
of analysis are clearer than in conventional factor analysis, since 
many factor loadings have been fixed to be precisely zero. Further- 
more, the model which is fit statistically to the data thus corres- 
ponds exactly to the model which is interpreted. Factor one 
involves all of the generative strategies except classification, and 
also involves related selection strategies, and hence refers to a use 
of generative operations • Factor two involves the generative opera- -—^ 
tions classification: association, previous knowledge and unstated re- 
lationships; and sequential selection of central ideas. Thus factor 
two reflects inferential selection strategies and generative operations 
and may be described as involving inferential organization of central 
ideas. Factor three appears to represent unstable selecton strategies. 
Factors four and five appear to represent rather specific retrieval 
strategies: retrieval of selected details in serial order and rote . 
memory respectively. Factor six appears to represent a st ategy 
involving the generation of unstated relations involving unfamiliar 
ideas, and seven involves attention to parts (as opposed to classifi- 
cation operations on the structure as a whole). Analysis of the struc- 
tural relationships among selection, retrieval, and generative strategy 
measures obtained under condition A (with repeated exposure) does appear 
to result in strategy combinations which include very general classes 
of operations (generative operations), organizational processes Invol^^ing 
the semantic structure as a whole (organization of central ideas), 
aspects of information selection, and specific retrieval strategies. 
Estimated intercorrelations of the factors and correlations of the 
factors with the extension variables are reported on Tables 7.14 (b) 
and (c) . In general, these strategy-factors appear to be relatively 
independent of one another. 

Inspection of the results reported in Tables 7.15 and 7.16 indicates 
that interpretable combinations of strategy measures occur for condi- 
tions B and C as well as for condition A. Two strategy-factors 
occur which are common to all three contextual conditio: * . ition 

to parts and rote memory, A factor representing ^-nc- : .rs.tions 
occurs under conditi-on B (factor five) as well as condition i\ as does 
a factor involving unstable strategies. In addition, two strategy 
combinations occur under both conditions B and C: classification of 
selected ideas and elaboration of unfamiliar ideas. Also occurring 
for conditionsB and C are strategy combinations reflecting infer- 
ential operations: inferential selection (factor six, condition B) 
and inferential operations (factor one, condition C) . This latter 
result appears to reflect an effect of the context-induced inferential 
operations described in previous chapters* Finally, two additional 
strategy combinations occur under condition C: a retrieval strategy 
involving retrieval of selected ideas in serial order (factor seven, 
perhaps corresponding to factor four obtained under condition A); and 
a factor which appears to involve the elaboration of lexical elements. 
In general, it appears as if there are systematic qualitative differ- 
ences among individuals as well as quantitative differences related 
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to processing efficiency. While the results reported in this 
chapter leave little doubt that important quantitative and qualitative 
differences exist 'among individuals, in the long run, any detailed 
understanding of sources of individual differences will require a 
detailed understanding of the sequence of processing operations 
involved in acquiring semantic information from discourses, Studies 
of individual differences in discourse processing can both profit from 
and contribute to knowledge concerning the basic processes involved 
in acquiring knowledge from discourse. 
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CHAPTER 8 
SimNTICS AND COMPREHENSION 



8 . 1 Introduction 

If psychologists are ev'^r to understand how human knowledge is acquired, 
they are going to have to come to grips with the difficult and elusive 
problems of semantics • An expansion of the meaning of the preceding 
statement will have to focus on specifying a meaning for "human know- 
ledge" and a referent for the adverb "how". In fact, problems of 
semantics are encountered in trying to explain either term. Human 
knowledge consists of a variety of sorts of information, but certainly 
includes information which is derived from linguistic expressions but 
which is not identical to the surface form of those expressions. Further- 
ra<)re, it is tempting to suppose as a working hypothesis . that much of 
human knowledge is represented in terms of a single "canonical" form 
and that this single form of representation is, derived from linguistic 
experience. A description of the manner in which human knowledge is 
acquired must certainly include both a description of the sources of 
human knowledge and a description of that knowledge which is acquired. 
Such a description will also consist of an account of the series of 
operations which result in the acquisition of that knowledge. 

Suppose we restrict our attention to the problem of explaining how 
knowledge is acquired from a single source: a particular English 
discourseV To make the question "How docJ a person understand the 
discourse?" answerable requires that we be able to specify in detail 
both the structural information which is contained in the discourse 
and the structural information which is acquired from the discourse. 
If structural representations of an input discourse and the information 
resulting when that discourse is understood were available, one could 
then begin to consider the psychological processes necessary to generate 
the latter from the former. Since the contents of the human mind are 
not directly available for our inspection, the obvious place to look 
for a structural theory of human knowledge is at natural language 
discourse. Thus, the strategy involves first seeking to develop a 
semantic representation of u. :ural language discourse (which is 
available for our inspection), both as a means of specifying the 
structural characteristics of linguistic inputs and as an hypothetical 
starting point for a model of human knowledge* 

The curious fact is that not until recently has this strategy been ■ 
adopted by psychologists interested in language comprehension and the 
acquisition of knowledge from discourse. This strategy has been adopted 
recently by Crothers (1970, 1971) in his work on memory structures and 
the recall of discourse and, at least in a preliminary fashion, in 
recent models of semantic memory (Ruomelhart, et al., 1971; .Kintsch, 
1972; Norman, 1972; Quillian, 1968)/' This strategy of course has long 
been adopted at the syntactic level by psycholinguists working in the 
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tradition of generative transformational gratninar who were interested 
primarily in the processing of syntactic information* More recently, 
computer models of semantic information processing have tended to 
concentrate on developing either parsing programs or logical components 
of a processing system. The form in which semantic information is 
represented in these programs (the propos j tional structure) has tended 
to be dictated more by the requirements of the logical component of 
the system than by semantic characteristics of English discourse. 
Thus, semantics has tended to ^'get loBt" in between the parser and the 
logical components which operate on acquired proposiuional information 
(cf. Minsky, 1968; Winograd, 1972). In fact, it appears that if a 
semantic information processing system were built around a semantic 
model derived from natural language discourse, the logical components 
in the system would have to be capable of operating on propositional 
structures which are different in many respects from those handled in 
current programs. Furthermore, if a computer model were built around 
an adequate theory of semantic representation, that part of the program 
which semautically "interprets" syntactically analyzed Inputs is alsc 
likely to be quite different" from the interpretive component of current 
systems (cf. Schank, 1971). For example, it will be shown In Chapter 9 
uhat many common expressions require structural representation^ in 
which not all of the semantic structural information is explicitly 
marked in the surface structure. Considerations such as these imply 
that any model which incorporates a realistic semantic model (which is 
capable of representing English discourse) will have to be capable of 
generating structural information which is not explicitly represented 
in the linguistic input. 

There is still another reason why a psychology of learning and cognition 
must come to grips with problems of the semantics of discourse, a 
reason which motive.Led many of the developments to be reported in the 
following two chapters. If we accept the arguments developed in 
Chapters 1 and 2 for selecting that task to 'measure comprehension" 
which is most general and adopt the base comprehension task as a 
general paradigm for studies of discourse comprehension and semantic 
memory, then we are confronted with the problem of developing a scoring 
system which is capable of representing a subject ^s verbal response\^ 
semantically against a semantic-structural model of an input discourse. 
Once such a procedure has been developed fcr the base comprehension 
task, it may be applied very 'generally to many situations in which the 
data consist of verbal protocols. In experimental work, the semantic 
model has two important functions: in representing formally the semantic 
characteristics of the task used to study comprehension and in analyzing 
subjects'^ v rbal responses. A well-defined semantic model is necessary 
for the former function, even 'in tasks in which only choice responses 
are obtained (e.g. in sentence verification, question answering, 
judgments of semantic acceptability) . 

In both Crother's (1970, 1971) work and the present work, the problem 
of developing a semantic representation of discourse has been approacued 
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by trying to develop a solution to the scoring problem — to develop a 
means of representing logico-seniantic information acquitad from. a ^ 
discourse from an analysis of subjects* free verbal reconstructions 

of knowledge acquired from a preseriteu dis^ s appears to be 

a desirable way to approach problems of three principal 

rea^ona. First, in developing a proce subjects' recall 

protocols, one is continually presente - ji particular 

dlscoi^rse to be analyzed, but aleo witii j of recall protocols, 

each of which contains semantic information which is reproduced in 
paraphrase from the discourse presented to the subjects and semantic 
information which does not correspond to explicitly presented informa- 
tion but which may be derived from explicitly presented semantic 
information. In attempting to identify input semantic information in 
such protocols, one is continually confronted with a variety of surface 
expressions constituting an '^empirical paraphrase set" for each .input 
semantic. structure . The problem of semantic analysis involves developing 
a single structural representation of that semantic information which 
is common to each member of the paraphrase set. Second, recall protocols 
obtained from exper iiaental subjects typically contain a large proportion 
of information which is subject-generated, i.e. which does not corres- ^ 
pond to semantic information which was explicitly represented in an 
input discourse in linguistically coded form. Such information* appears 
to include expressed presuppositions, results of formal inferential 
operations, expressions of retrieved information corresponding to le>cical 
elements, and sheer elaboration. The apparently universal presence of 
such information in subjects^ protocols suggests that a semantic 
representation of an input text ought to include some information which 
is not explicitly marked in the input discourse and, by providing 
samples^ of semantic information likely to be generated, recall protocols 
provide some indication of what inexplicitly coded information ► should 
be Included in the semantic model of a text and of the relationship of 
that information to that which is explicitly represented in a text. 
Finally, if one attempts to develop a semantic structural model as the 
basis for a scoring procedure for measuring semantic information acquired 
from a discourse, one is constantly presented with a linguistic "corpus" 
which has the sometimes unpleasant habit of not fitting easily into a 
preconceived semantic model. 

V = ; • ■ ■ 

8;2 Requirements for a Semantic Model * ' 

'There are a number of requirements which a semantic model must satisfy 
if it is going to be satisfactory as a model of linguistic inputs, as 
a model for memory structures, or as the basis for a scoring system- 
First, a semantic model should not represent the surface structure of 
a text except insofar as the surface structure uniquely represents a 
given semantic structure, and it should not be defined in terms of 
particular surface expressions or sets of surface expressions; rather, 
a semantic description should be capable of representing each text up 
to a paraphrase transformation and each element of the semantic structure 
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should be defined independently of any partl^ylar rules of expression 
(cf. Leech, 1969) • Note that, formally, this ^requirement of independence 
from surface expressions presents us with the following problem. The 
semantic model r^sts on decisions- with respect to which expressions 
constitute a paraphrase set; However, a paraphrase set cannot be 
defined precisely without first having a semantic modrl and a set of 
rules of expression. This circularity can be avoidec .n practice only 
by relying initially on linguistic intuitions concerning equivalence 
in "literal meaning'^ and thus by informally considering what expressional 
forms are equivalent in literal meaning, A model so constructed must 
of course eventually be expanded- to include a set of rules of expression 
and a surface grammar to formalize the definitions of what expressions 
are equivalent in meaning. Only then can the model be subjected to 
direct empirical validation. However ^ the experiment of Collins and 
Quillian (1969) illustrated one way in whic)i a semantic model can be 
indirectly validated without any consideration of expressional rules. 
Still another procedure based on statistical dependence properties of 
measures resulting from semantically analyzed recall protocols will be 
described in Chapter 10. 

A second requirement is that the model be capable of representing 
•'discourses consisting of many sentences ^aYid t"hat it treat sentence 
boundaries as purely surface phenomena haying no intrinsic semantic 
significance. A third requirement is that insofar as is possible, a 
semantic mddel should seek pnly to represent those semantic structural 
relations which a discourse imposes on i/s-^exical eleTnents and to main- 
tain intact lexical elements as elements of the semantic structure. 
* Thus, a semantic model should not attempt to ^nalyze lexical elements; 
rather a lexical element should be regarded as^an entry point to a 
subject's lexical memory, the meaning of tl\at element being that semantic 
information which a subject retr ievesNlf rom %his long-term memory store 
when the lexical designator is used as a starting point from which 
information is retrieved. This requirement leads to a method of semantic 
analysis which is substantially different from that advocated by 
linguists adopting the so-called "generative semantic" 'approach (cf. 
Maclay, 1971; Lakoff, 1971). Thus, our ultimate purpose in semantic 
analysis is not to specify a set of rules which are capable' of generating 
the set of all semantically acceptable texts; rather oiir purpose is 
•purely representational. The linguis^tdc viewpoint adopted in the 
present .jork resembles more the s tratlfUcatio'nal viewpoint of structural 
linguistics than any other current^^jstlliool ^of linguistic thought (cf . 
Leech, 1969). Just -as it has become apparent that derivational tree 
structures- are unlikely as internal representations of the syntactic 
structure of single sentences, it app^ears equally unlikely that internal 
semantic struQ^tures have such a structural form. In addition, it is 
difficult to imagine how derivational tree structures could be suitable 
for the representation of texts consisting of many sentences. The form 
of representation adopted in the present work is a graph-^s tructure of 
the" form used in computational linguistic work (Simmons, 1968, 1971), 
and consists of nodes corresponding to lexical elements which may be 
connected by directed relations taken from a limited number of defined 
semantic relations. ' 

o • /"-^ 
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In addition to the requirements just outlined, a semantic model- must 
also be well-defined, i.e. all semantic relations, the primitives of 
the model J must be explicitly and unambiguously defined. A semantic 
model must also be general enough to be capable of representing semantic 
information contained in subjects' recall protocols; and it must fit 
the linguistic data it purports to represent. I.e. together with a set 
of expressional rules and a sur^^ce grammar, it must be capable of 
generating all members of thr phrase set for any particular discourse, 

One might also hope that, ic model is developed and revised, 

it would be found to be c.j^ iVp to the semantic analysis of a large 
number of languages. It wu ..^^^ear that the best place to look for 
linguistic universals is at the semantic level. At least, this seems 
to be the working assumption among computational linguists seeking to 
develop computer translation systems (Simmons, 1971). Note that the 
requirement that all relational coifinec tives be well-defined and defined 
independently of surface expressions (i.e. not by example), leads to 
the adoption of a method which is initially inductive: examining 
examples to identify and define structural relations, and then deductive: 
explicitly defining a limited set of structural elements and combining 
these elements in the analysis of particular texts. 



8.3 Semantics of English Discourse 

The semantic structural model which will be presented in the next chapter 
is similar in many respects to the semantic structures described by 
Simmons (1971). Like Simmon's model (and other current semantic models, ^ 
e.g» Rummelhart, et al. 1972), the model incorporates semantic relations 
corresponding clqsely to the cases first described. by Fillmore (1968, 
1971). However, in attempting to formulate explicit definitions of 
case relations, it became necessary to depart from certain of Fillmore's 
cases. Certain of the relations of attribution defined in the model 
correspond to attribu tive^^relations described by Simmons. Quantifier 
relations correspond to /generally familiar quantifiers used in linguistics 
and logic. The definitions of conditional relations in the present model 
(relations which connect propositions and maUe one proposition's 
validity conditional on the validity, of another) were based on the 
papers of Rescher (1964) and Simon and Rescher (1966) which analyze 
contrafac tual conditional relations and relations of causality respec- 
tively. Relations .of equivalence, order, and proximity come from the 
algebra of relations and data theory (Coombs, 196A). The notion of a 
stochastic relation was adopted from psychological work on judgment and 
preference (cf. Tversky, 1969). Chafe's (1970) treatment of derivation 
was found to be valuable and many of his ideas concerning derivation 
were incorporated into the model. Leech's (1969) ^ treatments of such 
topics as relative location, time, tense and aspect, and modality formed . 
the basis for the treatment of these topics in the present model. Clark's 
(1972) discussion of types of negation formed the basis for the-«types 
of negation identified, in the present model, and' finally, Crother's (1971) 
discussion of the ^hierarchical and order properties of discourse was 
found to be particularly valuable. The influence of Crother's ideas 
concerning properties of discourse structures are apparent in much of 
what follows. . 
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CHAPTER 9 

GETIER-^L PRINCIPLES: GRAPH REPRESEIflATION 
OF SEMANTIC AND LOGICAL STRUCTURE OF TEXTS 



9. 1 Ixitroduction 

A discourse consisting of one or more paragraph's ■ has a number of 
properties whi^i^ ^^-'-^ n- icular importance in c .istructing a 

semantic or station of the set of sentences consti- 

tuting the pa.. ^a(o;. me method for representing the semntic 
and logical structure which is adopted here tal^es certain of these 
properties as a starting point for the analysis of a text. In 
particular, eight "basic" semantic properties of texts consisting of 
one or more paragraphs are of interest. The basic elements of our 
semantic analysis correspond to these basic properties . The 
properties my be stated briefly as follows. 

1. The sentences constituting a text are paraphrasable . 

2. The semantic structure of a text is represehtable as a 
relational system. 

3. The logical structure of a text is representable' in terms 
- of certain logical connectives defined on propositions 

represented in the semantic structure. 

k. Ordered sequences of semantic relations .representing a 
text have a unique dominance order. 

5. A text usually possesses inexplicit tautologous semantic 
and logical relational structures. 

6. The semantic structure of a text is hierarchical. 

7. Representation of texts semantically requires certain 
logical transformations of semantic and logical relations. 

8". Every text requires concatenated embedding of structural 
elements . 

The first property refers to the fact that different sentences can 
be equivalent with respect to truth or falsity. In terms of logical 
implication, two sentences which are from a set of sentences which 
are paraphrases of one another, logically imply each other. From 
the point of view of semantic analysis, it is desirable to represent 
a set nf sentences which constitute a "paraphrase set" in terms of 
a single semantic representation, i.e., it is desirable to regard 
the set of sentences as an equivalerice class with respect to a given 
•representation in the semantic structure defined on the set. A 
problem not considered here, is that of specifying rules of expression 
which are capable of generating grammatical sentences in the equiva- 
lence class of sentences for a given semantic, structure. ^ 
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The second --..nd third properties refer to aspects of semantic or 
logical rep '^sentations of sentences. The "basic constituent elements 
of the sema. ',c structure are concepts , represented in the structure 
as words (" les") -denoting the lexical meaning of the words, and 
certain dir jd binary relations connecting concept-pairs. The 
basic strucLi; al element in the semantic representation is an 
ordered triple or set relation Cj[ R-j consis'' ng of a concept C^, 
a connecting relation R j , and a concept C-^. Word-concepts will be 
taken^as primitives in i-he present analysis. The nature of lexical 
representations for concepts will not be considered and judgments of 
synonymy in scoring will br ased on a standard dictionary citation 
and on context. 2,3 Tl: iiemantic structure for a text consists 
of a network of set relations organized into a branching tree 
structure or directed graph (c.f., e.g., Harary^ Norman, and 
Cartwright; 1965)0 Diagrammatically , the semantic structure consists 
of nodes (concepts) connected by directed lines (relations). This 
graphical network is called the semantic structure graph. Every 
ordered triple or set of ordered triples of the semantic structure 
defines a proposition which is either true or false. 

The basic constituent of the logical structure is em ordered triple 
or logical relation Pj[_ consisting of a proposiJ;ion PjL(repre- 

sented structurally in tne semantic structiire graph), a connecting 
logical relation Lj , and a proposition P-^. Sets of logical relations 
can be arranged into directed graph structures with nodes representin 
propositions and connecting directed lines representing logical 
relations. This second type of graph is called (for want of a 
better name) the- logical structure graph. Thus properties two and 
three indicate that associated with any text (and its set of 
paraphrases) are the two graph structures defined here-.-a graph 
representing the semantic structure and a graph representing . the . 
logical structu. -^Z . 

Property four indicates an important property of the semantic 
structure, namely thatv.qf dominance. Consider the sentence ^ 

^2 ^1 ^3 

"Tall men read books." 

which is represented graphically as R^ ^2 "^2 ^3 ^3 (^^^^^^"^^^^^ 
of types of relations will be presented later). Let P^ = [Cj^ ^1^2^' 
Pg = [Cj R-j_ Cg R2 C^], and P^ = [C;j_ R-^ ^2 ^3 ^3 ^U^' /^^^ ^3 

implies P2 which implies P-j_ (i-e., "Tall men read books" implies . . 
"Tall men read," which implies that some men are tall). The 
dominance property of such a sequence of set relations is thus 
defined: any proposition given by a sequence of set relations up to 
a particular node implies the proposition given by the sequence up 
to the node immediately to the left of ( superordinate to) that node. 
A second interpretation of dominance may be made in terras of 
successively differentiated concept sets. In the above example , the 
graph may be interpreted as differentiating the set of men into 
those men who are tall, this set into those tall men who read, and 
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those ,tall men who read into those tall men who read hooks. The 
dominance order : w be interpreted as successive differentiations of 
the left superordii... 'e concept set. 5 The dominance property des- 
cribed here characterizes any semantic struct\ire which is an ordered- 
sequence • Such order properties have not been a feature of most 
semantic descriptions of English. This ordering of the semantic 
relations representing a text is established principally by the 
hierarchical^ nature of the semantic , structure graph (c.f., property 6) 
and by the directionality of case relations having causal significance. 

Property five is extremely important for the semantic representation 
■of texts (and for research on semantic memory and comprehension). 
Referred to here is the fact that while-, for many texts there is an 
explicit semantic structure and an explicit logical structure 
(explicitly represented (coded) in the surface structure of the 
text), there is also a- logically inferrable set of semantic relations 
and/or logical relations which is not explicitly represented in the 
surface structure of the -text. Such structure is tautologous in 
jthat its derivation i.s strictly^ logical, involving only the explicit 
•-struc ti^re and lexical meaning of concept-words. Note, that in the 
analysis of. (e.g,) causality, the notion of inferrable meaning may 
have to be expanded somewhat to include inferences based on semantic 
information outside of that represented in the text (e.g., some 
elementary physics in causal inference). Particularly likely to 
be omitted from the explicit structure are structxares involving 
superordinate concepts, 6 ^ote that it is not in general possible to - 
represent in the semantic and logical structure graphs all inferrable 
set relations and logical relations, especially since such relations 
can involve concepts or propositions not stated explicitly in the 
passage. This situation is a property of logical systems and might 
be termed '^openness of meaning." The convention that will be chosen 
here is to represent structurally only those superordinate concepts 
necessary for the semantic structure graph to be hierarchical (a 
tree structure) with a single left superordinate concept-node . 
Property six refers to the occurrence of such an hierarchical 
structure for any text. A text for which this property does not 
hold would appear to have to be exceptionally disconnected with 
regard to subject matter, and will be considered to consist of 
multiple texts. Thus property six will be taken as a defining 
property of a text. ; 

Property seven essentially qualifies properties two and three. Thus, 
while the semantic, and logical structures of some texts can be 
represented ;.ln terms of certain relations connecting concept-pairs 
and certain logical cortnectivfes linking propositions, it may be 
necessary for a relation or logical connective belonging to the 
semantic and logical structure graphs, (respectively) to bd represented' 
as altered C'qualified" or ^'operated upon^' ) in some way. . For example , 
since' any proposition is either true or false, and since by convention 
propositions are only represented which are true, the truth value of 
a proposition may be altered, either by negation (reversal of truth ' 
value),- by probabilistic qualification (rendered true with some 
probability)-, or by interrogation ( truth-value interrogated) . An ^ 
example of an expression of negation is, of course-, not; the 
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probability operator y be "expressed (e.g.) using the modal 
auxiliaries jpay and can . Other operators vhich have beer: found to 
be necessary are operations on temporality (e.g.^ tense) ^ node 
de?.etion (e.g.^^ participles ^ ger\mds ^ trxmcated passives j> some 
infinitives^ and \mclear antecedents of pronouns), anc! conditiona- 
lity (rendering the truth value of a proposition conditional on 
other propositions being true). 

The final property refers generally to the fact that for every 
proposition containing more than one relation , the left concept 
node for the second relation in the chain consists of a proposition 
defined by the preceding triple, the left concept node for the 
next relation in the branch consists of the pi'oposition defined to 
that point in the chain, etc. To illustrate, return to the example 
, "Tall men read books,'* Cj^ Rj^ represents "Some men are tall"; the • 
next relation given by R2 represents the statement that "Tall men 
read," the -left "concept" node is the proposition (C^ R]^ Cg) and 
the triple representing "Tall men read" should actually be represented 
as (C2. ^^1 ^2) R2 etc. Thus the semantic structure graph for 

"Tall men read books" should be written (C2^ R-l Cg) R2 ^o) R3 Ci^. 
Since this property of concatenated embedding (set relations are 
embeidded in set relations) always holds, it is not represented 
formally in the semantic structure but rather assxomed. However, 
embeddings can occur which must be formally represented in order to 
be unambiguously defined.'^ 

9 • 2 Semantic Structure 

9 .2.1 General consi derations i The semantic structure graph of a 
connected discourse represents in diagrammatic form the semantic 
content of statements which assTB?;t the occurrence of actions or 
states and specify further descriptive information pertaining to the 
asserted actions or states. Thus, a stated proposition is regarded 
as an assertion by. the speaker communicating the information that 
certain .events (actions) or states known to the speaker have, are, or 
will take place or obtain at some time, in some location, to some 
degree, etc. The semantic analysis of a speaker* s sentence is based 
on a categorization of the asserted events or conditions surrounding 
the asserted event or state. The present semantic analysis follows 
that of Fillmore (1968) in treating the basic semantic structure of 
a sentence as consisting "of a verb and one or more noun phrases, 
each associated with the verb in a particular case relationship" 
Cp.. 21). This analysis differs with Fillmore ' s^in its attribution 
of a particular dominance order (see the discussion of property four^ 
above) to the semantic elements of a sentence, and in its definitions 
:pf particular case relations. \ 

Definitions of case relations utilized here are different from those 
of Fillmore (1968, 1971) for a number of reasons. First, it was 
considered unacceptable to have an "open case" containing all case 
relations not classifiable into the other defined cases. Since the 
-jpurpQse df the present analysis is tp represent the "meaning" of a 
text, all "cases must be explicitly defined; ^new cases ought to be 
Opined as they become necessary. Second, the object case of 
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Fillmore* s 1968 paper, taken in his narrow sense of things which are 
affected by the action, or state identified by the verb, logically., 
includes his dative, an animate being affected by the state or action 
of the verb 5 unless "thing*' is read as inaxiimate. Tliird, rather than 
treat adjectives as stative verbs, it appears psychologically and 
semantically more reasonable to define specific p-" ^ • ' relation 

For similar reasons ^ the attributive ' . -x were 

defined. In the presf iit model, the in:^ crument case of i'illjnore ( I968) 

been r.arrowed to include only inani:Tiate nouns directly causing 
::ne action of the verb, since e maim^^ r class of adverbial modifiers 
would ap:^eai* to be included wi.^r:i:i Fillniore^s instr-'oment case. In. 
terms of the case relati ^ns hyp j^thesized by Fi.llJnore in his later 

1971) paper 5 there is n 'Ugh quivalence between the source, 
locative J and temporal cascs; id between Fillmore* s " Exper iencer*' 
and "Goal/V and the dat: e and factitive cases of the present 
analysis, respectively. ^lllmore's "Agent" and "Instrument" cases 
are different from those the present analysis; the differences 

will be discussed at ±enr^^.:i belcw. Filljnqre^s object case, remains 
"open in his later pape. ; the present analysis defines the object 
case specifically and then defines two additional cases "theme" and 
"goal'' ( t:he latter not to be identified with Fillmore* s goal case 
which is called factit ve here). Tlie logical structure and trans- 
fc^maticns ■ of either seniar_t:ic or logical relations are not considered 
in Fil -more * s analysis - 

A ^ist f the designated re^tions wriich may occur in the semantic 

struct re graph is present^ 1 in l2.ble 9 -1^— d a summary of the defini- 
tions . *^ certain case rela ions t:3 action and state verbs is gi^/en in 
Figure -1. Semantic relatioiis ar*e classified as those involving 
attribution^ quant if icatic._ of concept-se^ s , relations to action 
verbs 5 relations to state verbs, and certc-in other z^elations 
pertainixLg to action or staT.e ver^bs including adverbial modifiers 
specifying location or spatial position (locative)- time or temporal 
interval (temporal) ^ degree of ' -tion or state (degree), and the 
manner In which an action took r lace or a state obtained (manner); 
and the rela'tions goa], and theme 

9 * 2.2 A ttributive relations . h.e attributive relations are broken 
down into (1.) those paraphrasabl-, using the verb IS or IS A and 
(2) those paraphrasable using HA" . Of the attributive relations 
pertaining to IS or IS A constru oions . are ' relations specifying an 
extensive (quantitative) propert:.- of a concept (E>:t) such as "tall 
boy^" or "the boy is ten years eld," and relations specifying either 
categorical properties of a- concept-set (ordered classes) (CAT l) or 
'i. classification of a concept b// assigning it ^o a particular class 
' CAT 2)- .Ei^ajnples of these two sorts of GAT relation are "bright 
children" ( ..-sed in a categorical sense) and "tr e ^ slanders consisted 
: f farmers ^^nd ranchers." An e>. tensive property "is treated as 
categorical only if its usage is c J early categor cal^ as in "the 
bright cnildren were few _ in nu'ib^r than the du 1 children," The 
£: ;e: :-l form of the rrlal ion EXT i^ 
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List of Designated Relationis in Semantic Structure Graph 



Attribution : IS , ISA 
IS 

IS A 



extens Ive property 
ordered classes (CAT l) 
Classification (CAT 2) 



EXT 1 



CAT 1 



CAT 2 



-> 
-> 



IS 

IS prep, 
IS + prep. 



identity 
location 

time 



^ IDENT ^ 



-> 



liOC 1 
TEM 1 



II. Attribution: HAS 



HAS part 
HAS 



object property 
possession 



III. QuB.ntlf ication of Noun Concepts 



ALL universal quantifier 

NUMBER coiant nouns 

TOKEN particular instance 

DEFINITE definite referent 

^ negative quantifier 

EACH for ail 

a - existential qioantifier 



IV. 



Case Relations to Action Verbs 



HASP 



POSS 



NUM i 



TOK 



DEF 

z 



EACH 



a 



-> 
-> 
-> 
-> 
-> 
-> 



AGENTIVE 
DATIVE 
INSTRUMENTAL 
. OBJECTIVE 
SOURCE 
FACTITIVE 



AGT 



DAT 1 



INST 



OBJ 1 



SOURCE 



FAC 



-> 
-> 
-> 
-> 
-> 
-> 



V. 



Case Relations to State Verbs 



DATIVE 
OBJECTIVE 



DAT 2 



OBJ 2 



-> 

-> 
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Table 9-1 (cont . ) 



197 



VI. Adverbial iylodifiers 

LOCATIVE 

TEMPORAL 

DEGREE 

MANNER 



ordered classes 
classification 



LOG i 
TEM i 



-> 
-> 



DEG i 



MAN 1 



-> 



MAN 2 



-> 



VII . Further Specification of an Action or State 

GOAL 
THEME 



GOAL 



THEME 
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Figure 9*1 

Case relktions to action and state verbs, 

B: VERB 





action 


state 


animate 








AGT 


CAU 


A: NOUN 






inanimate 


INST 


CAU 



A is the immediate (proximal) cause', of B, 



B: NOUN 



animate 



inanimate 



A: VERB 



action 



action 



state 



state 



DAT 1 


OBJ 1 


FAC 


FAC 


DAT 2 


OBJ 2 


CAU 


CAU 



(1) B is affected directly (proximally) by A. 

(2) B resxilts directly (proximally) from A. 



(1) 



(2) 



(1) 



(2) 
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open interval on an attribute scale, and the relation EXT i assigns 
property B to A. If * i = 1, then EXT i assigns an attribute scale to 
A but does nothing more than designate the attribute B as applicable 
to A. If i = 2j then EXT 2 maps A onto an interval on the attribute 
sca."_e but does not specify a point value for A (e.g.^ "John is tall"). 
In this latter case (EXT 2), the attribute scale is denoted by a 
name designating a direction on the scale followed by a minus sign 
if the direction is to be construed as negative. Tlius "John is short*' 
is represented: 

John ^'"^ ^ > short {-) ^ 

where short is construed as the negative direction on the "scale of 
height. Point values of the attribute are specified by the relation 
DEGREE (e.g. 5 ''John is six feet tall"). An interval assigned by the 
relation EXT 2 is open in that it does not have specified endpoints. 
A closed interval may be specified using the relation DEGREE to 
specify point values for the end-points of the interval (e.g.v, "John 
is between five and six feet tall"). In EXT 2, an adjective may 
function to assign to each value on the attribute scale a probability 
that each proposition which specifies a particular value for the 
attribute is true ^ i.e.^ the relation EXT 2 may be thought of as 
inducing a probability distribution or cumulative probability distri- 
bu-Bion on an attribute scale. In scaling theory^ such distributions 
have been called di^scriminal processes (c.f.. Bock and Jones ^ I968) . 

Attributive relations involving HAS are of two types, (l) relations 
denoting an object property of a concept such as a part of the body 
(e.g., "John's hand*') (HASP for HAS PART), and (2) relations indicating 
possession of something repre^entable as a noun (POSS) (e.g., '^John's 
ball"). HASP- and POSS ^ 'may be distinguished by the following test: 
if the proposition involving HAS is necessarily true, the relation is 
HASP (inalienable possession); otherwise it is POSS. Confusion of 
EXT and POSS can occur with such nominaliEed concepts as "intelligent" 
and "intelligence"; generally, the sentences "John is intelligent" 
and^'john possesses intelligence" will not be taken as paraphrases of 
each other. The first sentence will be taken to mean "John is 
intelligent to some ( unspeicif led) degree" and the second as "John 
possesses the faculty (nominalized attribute) of intelligence," The - 
sentences "John possesses a fair degree of intelligence" and "John 
is. fairly intelligent" will not be taken as synonymous, although the 
difference in meaning is admittedly fi .e and likely to depend on 
context. In instances such as this, the strategy adopted in/deciding 
on a semantic representation was to "follow" the sur-face str'{icture 
of the sente nee . Confusion of IiA.SP and CAT may also ofe^mr . In 
general, HASP will be used when in . ' 



A is a single entity or collection, of entities each of which is a 
system of interrelated parts which are not homogeneous (i.e., do 
not possess a large number of semantic features in common) and B is 
an entity or set of entities as in "the antelope has antlera"; CAT 
will be used when in. 
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A is a collective noun: a-e€iHection of elements which are not 
necessarily an interrelated system , the elements of which all possess 
a large number of semantic featujres in common^ and which possess a 
small nimiber of features which differentiate them (a homogeneous set): 
and B is a category (classification) or categorical property. 

9.2.3 Derived attribution . There are three common types of '^attri- 
butive^'relations which are basically different from the attributive 
relations just described even though they^may be expressed using the 
verb IS, The nature of this difference may be seen by considering 
the following sets of sentences: 

Ija The window is broken 

lb The window has been broken. 

Ic Someone has broken the window. 

2a This cereal is edible, 

2b This cereal can be eaten. 

2c One can eat this cereal- . 

38- John is sad. 

3b John feels sad. 

The characteristic of sentences la, 2a, suid 3a which renders them 
different from such sentences as ''"^^ window is large," "The cereal 
is soggy," and "John is tall" is their derivative nature: la may 
be considered to be derived from Ic (since "broken" involves nothing 
more than the result of the action "break" ) , 2a is derived from 2c 
since "edible" specifies only that the cereal can be the object of thi^ 
action "eat," and 3a is derived from 3b since "sad" characterizes an 
understood stative verb "feel." The attributive surface forms repre- 
sent convenient abbreviations of the underlying propositions from 
which they are derived^ Attributives corresponding to expressions 
such as these will be referred to as derived attributes and will be 
represented semantical3;y. in terms of the semantic structixres (invol- 
ving active or stative verbs) from which they are derived. Three types; 
of derived attribution correspond respectively to these three examples: 
(1) resultive attribution: expressing as an attribute the result of 
an action (cf. Chafe, 1970, pp. 12^^-125), (2) deactivative attribution: 
expressing as an attribute the fact that an object can serve as the 
object of an action (cf. Chafe, 1970, pp. 131-132), and (3) experien- 
tial attribution: expressing as an attribute an experienced state* 
The structioral representation of each type of derived attribute 
requires the use of semantic relations defined in later sections. 
However 5 for subsequent reference the general^ form for proposi ""ions 
indicating derived attribution will be presented here, 

1. resultive attribution: : i?An pat o 

• action > [A — 2^1^— > x] 

2. deactivative attribution: ^ntta-t / ^ ^r«\ r^^^ 

^ QUAL(AGT) ^ OBJ ^ ^ • 

/ X -ii— ; — i — r — ^ ^> action ^> A 

^- (can) : — 

3. experiential attribution: J" DAT 2 ^ MAN 2 ^ ^ 

A — > feel — > B 

In the above expressions , A and B refer to specified concepts and X 
-r^^RTS either to a "dunoouy concept" which is completely defined by the 
:ext (e.g., "broken") or to any unspecified concept. 
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9.2.k Quantifiers . Quantification of noun concepts is denoted in 
two ways in the semantic structxore graph; either by indicating the 
nature of the quantification in parentheses after the noun (if 
superordinate levels*^ of quantification are not represented) or 
by indicating the quantifier as a relation (if the superordinate 
concept is represented in the semantic structure). The levels of 
q^;antif ication represented incluLw;: -^-tarting with the most general 
set and proceeding to the smal • ji ncept set, i.e., from super- 
ordinate to subordinate); th^ ^ -ii e.« i:ally quantified set (all 
insta: :es of a concept), e.g. "p- jple" or "all people"; a number 
of instances selected from the general class (NUM), e.g., "some 
people"; a particular instance from a class (TOK) , e.g., "a person"; 
a particular instance from a class which has a definite -reference 
to another concept (DEF) , e.g., "the person over there"; and" the 
empty cl^ss (negatively quantified set) (jz$) , e.g., "no people." 
Also represented, is the particular instance selected as representative 
of. a concept class (the logical "for all," EACH), e.g., "each of the 
boys has a pencil; and the existential quantifier, "there are boys 
who play ball." Tlie relation NUM may be further subdivided into 
two relations: ne . in which RUM assigns a positive integral value 
to the number of instances from the general class (NllM 1, e.g., 
"ten. boys" ) and one in which the relation does not precisely specify 
the number of instances from the general class (HUM 2). In the 
relation NUM 2, the relation may either specify the count to be in an* 
open interval (e.g., "some boys," "many boys") or in a closed interval 
(e.g., "between 10 and 15 boys"). Open and closed intervals are 
denoted in the same manner as for the relation DEG 2(to be discussed 
below). The relation KUM 2 may also function in a manner parallel 
to the extensive relation EXT 2: it may be tTE^ought of as inducing 
a discrete probability distribution on the positive integers. 

9.2.5 Case re-lations . Case relations to action verbs (which by ---' 
definition represent a change of state) and relations to stative 
verbs are summarized in Figure 9.1.. Consider first the cases in which 
in tlie relation A R B, A is anything representable as a noun and 
B is a verb. If A is animate^, B is an action verb and the relation 
is "A is the immediate (proximal) cause of the^ change of state 
represented by E," the relation is labelled "agent" (AGT) : if it is 
inanimate, B is an action verb, and the relation is "A is the 
immediate cause of the change of state represented by B," the relation 
is that of instrumentality (INST). If B is a state verb, then B does 
not represent a change of state, and thus does not have a proximal 
cause. The relation CAU is used to represent distal causes including 
causes of states in which the action leading to the state has not 
been specified (e.g., "The exam made (CAU) me feel terrible"). If 
A is the agent of an action verb B^ and A also is directly affected 
by the action of B (i,e., the verb is ref lexive ) then? A will be 
defined as both dative (DAT l) and agent (AGT) since A in this case 
shares AGT and DAT 1 relations to the verb. Note, that under the 
present definition of AGT and INST, if one considers a causal chain 
leading to an action, the instrument is that inanimate object which 
is asserted by the speaker to be proximally (immediately) involved 
n "the action of. the verb; the agent is that animate object most 
"•roximally- involved in the action of the verb. The directionality 
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of the relations AGT^ INST, -and, DAT (reflexive) is given by their 
causal significance to the verb. In general^ if the agent precedes 
the verb 5 then other noun phrases must follow the verb since they 
either differentiate the action caused by the agent or represent 
effects of the verb. If there is no agent, then the instrument 
adopts the role of agent in the order. 

Since it has been proposed by others that selection restrictions 
involving anima.teness ought not to occur in the definition of case 
categories (Fillmore, 1971), some reason should be offered for 
attaching the feature /n-animateness/ to noims functioning as agents 
and /-animateness/ to noxin's funcj^ioning as ins tniments , The sentence 

(a) ''John made the ball break the window" may be paraphrased "John 
broke the window with the ball," the instrument "ball" determining 
the preposition "with." But the sentence (b) "John made Judy oreak 
the window" may not be paraphrased "John broke the window with Judy," 
unless John used Judy as a physical object to break the window (or 

if they broke the window together). The critical feature in the 
above distinction is the animateness of Judy. Applying qur definitions 
of AGT and INST, in sentence (a) the ball will be taken as the 
instrument and John as the . agent, of the verb "break" ; in sentence 

(b) Judy will be regarded as agent of the verb "break," and the 
relation of John to the verb "break" must be expressed using the 
causal connective CAU (defined below)* A syntactic reason for 
treating the agent as "the most proximal animate cause" and other 
animate beings causally involved in the action as connected to the 
action by the relation CAU in the logical structure graph is provided 
by the following example. Given sentence (b) we may say "The window 
was broken by Judy," the agent Judy determining the preposition 
"by," but we may not say "The window was broken by John." We must 
say "John caused the window to break." 

Some additional remarks on the causal nature of agency and instru- 
mentality are necessary<, since causality is defined as a logical 
connective in the' logical structure graph, and AGT and INST are 
defined in the semantic structure but also involve oausal relation- 
ships to a verb. The problem is how may we distinguish between 

■ agency and instrumentality, on the one hand, and causal connectives 
on the other; i.e.; should the sentences (a) "John caused, the window 
to break" and (b) "The hammer caused the window to break'' be 'considered 
as paraphrases respectively of -(c) "John broke the window'' and (d) "The 
hammer broke the window"? In the present analysis, the sentence pairs 
(a), (c), and(b), (d) will not be taken to be paraphrases since (a) 

' and (b) appear to contain a possible ambiguity which sentences (c) 
and (d) do not: sentences ^ (a) and (b) may be used to express either 
(l) e. chain of causal events leading from John or th'e hammer to the 
window or (2) the agency of John or instrumentality of the hammer. 

It remains to indicate why the relations AGT and INST are represented 
in the semantic structure while CAU (the causal connective) is 
represented in the logical structiore. This distinction seems appro- 
priate for the following reason. Recall that the semantic structure 
Q )h represents statements which' assert the occurrence- of actions 
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or states and specify further descriptive information pertaining to the 
asserted actions^ or states. TJie logical structure represents rela- 
tions defined on propositions taken from the semantic structure which 
may place constraints on the propositions of the semantic structure. 
Oftc.i the semantic structure of a discourse is incomplete in , its 
description of the causal relationships involved in asserted actions 
or states; in these instances causal relations in the logical structure 
are required to completely specify the network of causal relationships. 
As an example, consider the following sentences: 

la The man hit the ball and the window broke. 

lb The man hit the ball causing the window to break- 

2a Ihe man hit the ball and broke the window. 

2b The man hit the ball and thus broke the window. 

3a The man hit the tall and the ball broke the window, 

3b The man hit the ball, thus causing the ball to break the window. 

Sentences 1 to 3 present increasing information about the relationships 
among the man^ the ball, and the window. For each numbered example, 
sentence (b) employs a causal connective to indicate a causal relation 
not given by sentence (a). Suppose, following the example cited by 
Fillmore (1971), that the causal system to be expressed involves four 
objects, a man, a bat, a ball, and a window, and the actions swing, 
hit, and break. The event to be described may be represented diagram- 
matically as follows : 



cause to 
br^ak 




•> window 
- A A 



One way in which this chain of events might be expressed is as follows: 
"The man swung the bat, the bat hit the ball, the ball hit the window 
and broke it." A complete description of the causal system above 
requires insertion of the causal connective "thus" (or "thus causing"): 
"The man swung the bat, thus the bat hit the ball, and thus the ball 
hit the window and broke it." As Fillmore pointed out, we can say 
"The man hit the ball" and "The man broke . the. window, " but we cannot 
say "The bat broke the window"; the latter causal relation requires 
the logical connective, as in "The bat caused the window to break." 
Thus, it appears as if the linguistic role of logical connectives 
includes the "expression of causal relationships which are inexpres- * 
sible (for various reasons) by other means. It also appear that such 
coxinectives are likely to be deleted ineveryday language, thus 
requiring the comprehender to' generate (infer) the deleted causal or 
other conditional relations for himself. 
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Now consider the cases sumniarized. iri the lower 'part of Figiire 9.I i^n 

which in the relation A R B, A is a verh (the action being the reafult 
of an agent, an instrument, or (for an action or state) the result of 
some causal sequence of events not necessarily specified) , B is 
anything representable as a noun, and the relation R is ''B is^affected 
directly (proximally ) ^by A." If A is an action verb, B is animate, and 
the asserted relatior^^is "B is affected directly by A," then the relation 
is defined as dative (DAT l) (beneficiary or recipient of an action^* 
If A is a stative verb, B is anima.te, and the r-^iation is '^B is affected 
directly by A,*' then the relation is designate DAT 2 (roughly equivalent 
to Fillmore ^s (l97l) '^Experiencer^' case). Thi: dative case relatic^-s 
may be separately defined corresponding to ac^ n verbs (DAT l) or 5 ,te 
verbs (DAT 2). They may be farther clasgifiec on the basis of part: 
cular effects of the verb on B (the change which A induces in B for 
actions and the type of state for stative verb"). Particular changes 
in B which may be identified are changes in attribution: EXT (e~. g., 
"He. made John (DAT) angry"), POSS (e.g., "He gave the pen to John"), 
HASP (e.g., "He removed the tumor from John" ) , LOG (e*g., "He pushed 
John into the lake"), and TEM; and actions (e.g., "He pers-uaded John 
to go"). Types of states may be classified on the basis of whether 
the stative verb takes the relation THEME (e.g., verbs such as "know," 
"believe"), the relation GOAL (e.g., "want," "desire"), or the adverbial 
relation MANNER (e.g., "feel" as in "feel cold"). (The relations THEME, 
GOAL, and adverbial relations are defined subsequently. ) Dative relations 
may either govern the preposition "to" (if the effect is to induce 
possession) or the case marker may be absent. Case categories such as 
DAT may be reflected in word order (Fillmore, I968). 

If A is an action or state, B is inanimate, and relation is "B is 
affected directly by A," then the relation is objective (OBJ). As 
with the dative, if A is an active verb the relation is designated 
OBJ 1 and indicates that a change in the state of B occurred resulting 
from the action A; if A is stative, the relation is designated OBJ 2. 
Particular changes in the object affected include changes in attri- 
butive relations and in actions involving B as instrument or cause. 
The distinction between DAT and OBJ on the basis of the feature 
/+animateness/ is made for. the following reason. Since a noun in a 
dative relation to a verb may also simultaneously be agent to the same 
verb (i.e., in the reflexive case), and since ainimateness is a 
defining feature of agency, then animateness ought to be a defining - 
featoore of DAT and critical feature distinguishing DAT from OBJ nouns 
which necessarily cannot act as agents. . ' 

The remaining relation in the semantic structure which is identified 
in FigTire 9.I is the factitive (FAC) relation defined when B, any- 
thing representable as a noun, "results directly (proximally) from" 
an action A. As with DAT and OBJ, different categories of FAC may 
be distinguished on the basis of the particular changes resulting from 
the action of the verb. The case relations DAT, OBJ, and FAC are 
illustrated by the sentences 

He gave the pen to John. ■ ^ " 

O ^ He persuaded John to go. 

He pushed John- into the lake. 
Soren made me a. toy house. 
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which may "be diagrammed as follows 

AGT ^ DAT 1 ^, 



He > gave 



jhn 



OBJ 1 

— ^> nen 



AGT ^ _ ^ , L-.T 1 



He > persuade 



-> John 



^ AGT . , . DAT 1 
he > pushed 



■> [John ^> go] 



John 



"^AC I or 
John — — > lake (def)] 



^ AGT ^ , DAT 1 
Soren > made i me 



FAC . CAT 2 ^ ^ 
~> [house — > toy] 



As in the case of agency and instrumentality ^ further remarks are 
required on distinctions hetween the relations DAT 1, OBJ and FAC 
which have causal significance, and the logical connective CAU 
represented in the logical structi;Lre. The problem involves whether or 
not the following sentence pairs should be regarded as paraphrases of 
one another : 

la John's anger frightened me. 

lb As a result of John's anger, I was afraid. 

2a He persuaded John to go. ' 

2b As a result of his persuasion, John went. 

3a The bad news annoyed me. 

3b The bad news caused me to be annoyed* 

In the present analysis these sentence pairs will not be regarded as 
paraphrases for the same reason indicated in the discussion of AGT and 
INST, viz., the second sentence of each pair is ambiguous with regard 
to the possible occurrence of intervening events. That the definitions 
of DAT 1, OBJ and FAC ought to be restricted to nouns involved proxi- 
^^ly in "the causal sequence, and that nouns indirectly ''affected by" 
or "resulting from" an action or state' oioght to be represented in the 
logical structure (using CAU) may be seen by considering the following 
chain of events represented diagrammatically) ; 



John 
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This chain of* event " 
shout v7oKe the dog , 
double lines in the 
woke the baby" and " ' : 
the baby. You can ^ 
lines in the diagram ; 
expressed using the 1^ 
agency and instr\imen- ?. 
causal connectives is 
ships which may not be 
A similar argument ca.. 
proximal result of ar^ 





je ex~" 


-^essed tv saying. "John shouted, the 




bark 


, and t "le bark woke :he ba 


r / ^ u n e 


- tr ^ " - 


' « i- 


note T. 'lat you can s ^-.y "Ti 


dog 


•IT; V 


.^e t: 
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'T 
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CIO oX/eo, 
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' conn-. 
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ii^- 


it a^- 


: rars as if in Englisa the 


role of 


in 


5 expr 


^sion of indirect causal r 


elation- 


rp; 


-sente 


directly in the semantic 


structure . 


b^ 


-de i-" 


considering FAC to invol\' 


- the 




. or z 


te . 





One remaining semantic 
relation to an actiori 
sentences as: 



.ion c^jignated in Table 9.1 as a case 
reniair : to be defined to handle such 



a, Soren made me a toy house from a cardboard box. 

b. He walked frc'i the top of the hill to the cemetery 



^ate , 



In these examples, "a cardboard box" and "the top of the hill" 
represent prior states of the object or being affected by or resulting 
from the action of the verb and "a toy house" and "the cemetery gate" 
represent states resulting from the action of the verb. Thus, the 
relation SOURCE is defined as follows. If A is an action verb, B 
is anything representable as noun, and the relation ARB represents 
"B obtains iimmediately (proximally) prior to A,'' then the relation 
R is tha-t^ of SOURCE. Note that SOURCE and FAC are symmetric: SOURCE 
represents a prior state, FAC represents a resulting state, and both 
states are spatially and temporally proximal to the action of the verb. 
Both SOURCE and FAC relations may be classified with respect to the 
nature of the prior or resulting state or action; the major categories 
appear to be prior states or outcomes involving: verbs of transforma- 
'tion which change a prior concept into a new one (e.g., sentence (a) 
above); verbs inducing a change in attribution (e.g., EXT: "He 
painted the red house green," POSS : ''The thief removed the man's 
money and left him penniless," LOC : Sentence (b) above, TEM: "He 
walked from noon until sundown" 9) ; and verbs inducing actions (e.g., 
"The mother made the misbehaving child go to his room"). Following 
Fillmore (1971^ P. ^l) ? it may be that sources and factitives occurring 
in relation to a single verb must be homogeneous, r.e,, category of 
prior or resulting action or state (including homogeneity with respect 
to particular attribute dimensions') . To illustrate how sentences such 
as (a) and (b) are represented graphically, diagrammatic represen- 
tations of (a) and (b) follow: 



(a) Soren 



AGT 



"> made 



DAT 1 



EKLC 



FOURGE 



-> me 



^ ^> [house (tok) ™. ^ > toy] 



-> [box 



CAT 2 



cardboard] 
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(b) He ^> walked - 



SOURCE ^ r„ LOG ' . HASP 
^> [He -> [hi (def) ^^^^> top]] 



FAC . LOG ^ , , HASP^ ^ 
^> L-He ^> [cemetery ^> gate].] 



Two additional classes of relations in the semantic structiire remain 
to be discussed; the adverbial modifiers specifying location, time, 
degree, and manner; and two relations which further specify an action 
or state: GOAL and THEME,. Since a discussion of adverbials of 
location, time, and degree must inevitably include consideration of 
relative item^ relative position, and relative degree, and since 
these relativfe adverbials involve connectives defined in the logical 
structure (in particular order, proximity, and certain algebraic 
relations), this section will conclude with definitions of the 
relations of time, location, and degree.. Relative adverbials of 
location, time, and degree will be discussed in the next section. 
Analysis of adverbial relations of location and time are based in 
part on Leech's (1969) discussions of locative and temporal expressions. 

The relations GOAL and THEME are necessary to represent certain case 
relations to verbs which do not represent instances of any of the 
case relations previously defined. The relation GOAL is defined as 
follows: If A is an action (or state), B is a future state (or 
future- in- the-past if the verb's action occurred in the past)-, and 
the relation is "B is the immediate (proximal) future state towards 
which the verb's action is directed (or to which the state refers)", 
then the relation is GOAL. The relation GOAL appears to involve the 
actions of animate beings: actions which are construed by the speaker 
to be voluntary. The following example illustrates why (outside of 
considerations of sjTimietry with SOURCE and FAG) the relation GOAL 
is restricted to proximal states. Suppose John is studying because 
he wants to pass an exam, that he wants to-^ass the course in which 
the exam is given, and that he must pass the exam in order to pass 
the course. This example contains two goals, a superordinate goal 
(passing the course) and a subgoal (passing the exam). One can say 
"John is studying to pass the exam" and "John is studying to pass the 
course," but "John is studying to pass the exam to pass the course" 
is not acceptable without marking the superordinate status of the 
second goal. One can say "John is studying to pass the exam, to pass 
the course" or possibly "John is studying to pass the exam and thus 
to pass the course. " It also appears that by "strengthening" the 
preposition "to, "an acceptable sentence results, e.g., "John is 
studying to pass the exam .in order to pass the course." Rank-equivalent 
goals may also occur as in the sentence "John is studying to pass the 
exam and the course," While there is some degree of symmetry of GOAL 
(future state) with SOURCE (prior state) and FACTITIVE (resulting 
state), it appears as if the syimnetry is incomplete since a sentence 
may include more than one goal while a sentence may refer to only one 
(proximal) prior state and only one (proximal) resulting state. 
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The relation THEME is necessa y for representing semantic relations 
involving certain verbs in wh^ch a state or a state resulting from the 
action of a verb has (or is understood by the speaker to have) 
symbolic significance (e.g., the stative verbs "know," "believe/' 
"understand*^; the action verbs "write," "dream," "think," "iiiiagi:ie'') . 
In the relation A R B, let A be an action or state and let B be 
anything representable by a noion. Then the relation THEME is defined 
as follows: B represents the (symbolic) content or a part of the 
content of a symbolic state or of the factitive symbolic state 
resulting from the action of A. The relation THEME determines the 
preposition "about," The 'following examples illustrate why in the case 
of actions THEME is defined as denoting the content of the factitive 
state resulting from an action: 

la He wrote a book 'about Chinese history, 

lb He wrote about Chinese hi story • 

2a He studied a book about Chinese history. 

^ 2b He studied about Chinese history. 

2c He studied Chinese history. 

In sentence 2a "Chinese history" is the theme of the book, but "book" 
is not the result of the verb ''study"; hence 2b is not acceptable. 
Sentence 2q, in which "Chinese history" is the object of the verb 
"study," is acceptable. 

9. 2 .6 Types ^of derived verbs . A semantic analysis of sentences 
containing action verbs has been presented which involves specifying 
(l) the causal agent and (or) instrument, (2) the object (animate or 
inanimate) affected by the action indicated by the verb, (3) the 
state which existed immediately prior to the change induced by the 
action, and {k) the state resul':ing from the action of the verb. 
The case grammar analysis of such sentences is verb centered in the 
sense that the event is represented semantically in terms of a verb 
and various concepts in case relations to the verb. Certain situations 
may occur involving action verbs expressing change of state and/or 
agency or instrumentality in which the action is derived from a 
"stative proposition," i.e., an attributive proposition or a proposition 
involving a stative verb. Consider the following sentences: 

la The road is wide. 

2a The road widened, 

2b The road became wide, 

3a The workmen widened the road," 

3b The workmen made the road become wide, 

^a She married him- 

4b She became his wife. 

5a The movie saddened him, 

5b The movie made him become sad. 

The active verbs in sentences 2a and' 3a are derived from the attribute 
of sentence 1 in the following ways. Sentence 2a differs from 1 in 
■:hat 2a ' asserts not only that a state obtains but in addition asserts 
:hat a change" of state has occurred* • The paraphrases of 2b makes 
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explicit the derived nature of 'Videned^' in this example. In such 
situations the verh "become^' contains no meaning other than the facty.. ^ 
that a change of state has occurred. 'The structural relations OBJ Ij— ■ 
DAT 1, SOURCE, and FAC , and the concepts connected to the verb 
'^bev^oine'^ by these relations completely specify the meaning, i.e., 
the verb ^^become" acts as a sort of "dummy argument'' beca,use it 
contains no meaning which is not already given by the structure into 
which it is embedded. Sentences such as Pa, 2b , ^a, U-b expressing 
simple change, possibly by means of derived inchoative verbs such as 
•'widen'' (cf. Chafe, 1970, pp. 122-12U), are represented structurally 
by the following general forms (the first for changes of attribution 
and the second for changes represented by stative verbs, viz , experiences) 



OBJ 1 

or DAT 1. 



become 



^> [X ? ~> Yg] 



DAT 1 ^ ^ 
^> become 



FAC ^ DAT 2 ^ , R ^ T 
~ ^> [X -> verb ■ > Y^] 

In general, if a sxirface sentence contains a derived verb other than 
'^become,'* it should be represented using "become" only if one of the 
above general forms completely represents the meaning and hence 
contains no concepts not expressed in the surface sentence • 

Sentence 3^ differs from sentence 1 in that 3^ asserts not only thax 
a state obtains but in addition that a change of state has occurred 
as. a result of an (unspecified) action of the agent ^Vorkmen," The 
paraphrase 3"b makes explicit the derived nature of the Verb "widened'^ 
in this example. As in sentences expressing simple change, structural 
relations (viz. ACT, INST, OBJ' 1, DAT 1, SOURCE, and FAC) and concepts 
Q:r connected to the verbs "make'* and ^'become" completely specify the 
meaning and the verbs "make" and "become act as "dummy arguments." 
Derived verbs such as "widened" in 3a may be either agentive + inchoative, 
or instrument ive + inchoative (e.g. sentences 5a and 51^). Note that 
the term "causitive'* is not used (cf. Chafe, 1970, p. 128) because in 
sentences such as 3"b and 5^ the cause is proximal, e,g*\, the sentence 
"The workmen caused the road to become wide" is ambiguous re. the 'pos- 
sibility that the workmen were only indirectly responsible for the . 
change. Sentences expressing simple agency + siinple change are 
represented by the following general forms : 

^ AGT OBJ 1 ■ 

EKLC 3. X-^^^^^> make [Y ^.2JLM^> become [Y Z]] 
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AGT 



, ^ or INST^ , FAn DAT 1^ , 

4. X ^> make > [Y => become 



DAT 2 



[Y 5^^> verb — > Z]] 



9 .2.7 Adverbial relations . Relations of location have the general 
f orn T _ _ . 

A ^?^.^ > B 



where A is anything representable by a noun or verb, B is a spatial 
location^ and the relation LOG assigns location B to the object or 

vent A. The relation LOG involves the parameters i and where 
. = 1 or 2 and j = 0, . . . ^ 3? Q-i^d these parameters specify each 
member of the family of relations called locatives c If the pareuneter 
1=1, then the relation assigns a point in' space to the object or 
event A; if i = then the relation maps the object or event A onto 
a region in' space , but does not specify a point location for A, The 
assigned region may be either (open (with unspecified boundaries as 
in the case of the relation EXT 2) or closed (with specified 
boundaries). The parameter j is equivalent in value to the dimen- 
sionality of the relevant space (relevant to establishing the location 
of the object or event A). The relevant dimensionality may net be 
equivalent to that of the physical system to which reference is made 
by the speaker; it will often be less depending on the presuppositions 
of the speaker. For example, certain kinds of relative location 
(e.g., locatives of direction and orientation) involve the presup- 
position of a fixed one-dimensional reference axis in two or three 
dimensional space. Relative locative expressions may also involve 
a point of orientation which may correspond to the speaker's location 
(e.g. J locatives of orientation). Some examples of relations of 
simple loc tion are given in the following list: 



point : 

A ^0^1 > B 

A -^^Cl > B 

LOG 1 
A (3^>B 

open region ; 
LOG 2 



"T2T" 
LOG 2 



■> B 



-> B 



-> B 



^ (37 
closed region: 



A 



LOG 2 



(1) 



-> 



at the door 



at the center of the lake 



at the top of the mountain 



on the road, on the border 



in the fields on the map 



in the box 



(LOG 1) 
(LOG ll 



between Washington and 
Philadelphia 
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The above relations of simple location, in combination w^th certain 
algebraic relations and relations of order, equivalence, aW proximity, 
peniiit one to represent semantically a great many expressions of 
relative location. Relations of relative location vill be discussed 
in the next section. \ 

Temporal information concerning objects or events in a discour^ie may 
be represented either by means of tense and aspect operators, or by 
means of temporal expressions (for both objects and events). /Tense 
and aspect operators speciiy relative time (relative to theyfactual 
present) and temporal expressions, semantically represent&<3 by struc- 
tures con'^iining the temporal relation 



A 



TEM i 



-> B. 



specify* either simple time (assignment of a point or interval on the 
time scale to an object or event) or relative time (relative to a 
point of orientation which may or may not coincide with the factual 
present). The relation TEM is defined as follows: A is an object or 
event, B is a moment or interval of time, and the relation 



A 



TEM i 



-> B 



assigns the^oment or interval of time B to A. 
relation 

TEM 1 



If i = 1, then the 



A 



-> B 



maps A onto a point on the time scale (e.g. 
i ^ ■ ' 



'at two o'clock"); i: 



2 5 then the relation 



A 



TEM 2 



-> B 



maps A onto an interval which may be either open (unspecified duration, 
e.g. J ''on Monday morning,'' ''in the spring semester.'* "in the future") 
or closed ( specified dioration, e.g., "between five and six o'clock," 
"for three hours"). In the latter closed temporal relations, either 
the end points of the time interval are represented: 



TEM 2 



-> 



t_ (TEM l)' 



t^ (TEM 1)> 



(e.g. 5 t^ = 5 o'clock, 
interval is indicated: 



t = 6 o'clock), or the length of the time 



A 



TEM 2 



-> T 



(e.g»5 T = 3 hours). Representation of relative times not involving 
tense such as- "before" and "after," measured intervals, relative 
duration and still more complicated structures require certain algebraic 
relations and order and equivalence relations. 
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Adverbials of degree are represented in the semantic structure by 
means of the relation 

DEG i 



A 



-> B. 



212 



v/here A is an event,, extensive attribute ^ extensive manner , or degree 
B is a point value or an interval on a magnitude scale (of degree), 
and the relation DEG i assigns degree 3 to event, attribute, manner^ 
or degree A. If i = I7 the relation DEG 1 specifies B to be a point 
value in some unit of measure w]:iich identifies the scale (e*g*, 
''John is six feet tall'^ ; if i = 2, the relation DEG 2 assigns to A 
a degree within either an open . interval (e.g., the intensifier "very'' 
as in "John is very tall," "John is average height," "John types 
very rapidOy") or a closed interval (e.g.^, "John is between five and 
six feet tall," "John types between fifty and sixty words per 
minute"). As in the case of the relation EXT 2, the degree scale is 
denoted by a name designating a direction on the scale which is taken 
as positive unless followed by a minus sign. As in the case of LOG 2 
and THA 2, closed intervals are represented. by giving the boundary 
points of the interval. Tiie effect of the degree relation (DEG 2) 
which'^assigns to A an open degree interval B may be to transform the 
distribution of (e.g.) heights associated with the attribute name 
("tall"), possibly additively or multiplicatively (Cliff, 1959). 

The manner relation (MAN) is used to specify categorical or extensive 
information characterizing an action or state, inijrmation not 
represented by the relations AGT, DAT, li^T, OBJ, SOURCE, FAG, GOAL, 
THEME, LOG, or TEM, The relation ■ corresponds to the attributive 
relations EXT and GAT defined for objects. Two types- of , manner 
relation are defined 1 The first type of manner relation- specifies 
that the action or strate belongs to a class of such actions or states 
in which the class may be either (l) an ordered class with respect to 
.other such classes or (2^ not ordered with respect to other classes 
(MAI^T 2). The adverbial relation MAN 1 corresponds to the attributive 
relation GAT 1 and MAN 2 corresponds to GAT 2. The second type of 
manner relation assigns an extensive ^(quantitative) property to an 
action or state and corresponds to the attributive relation EXT. The 
extensive manner reJ^tion has the general form 

MA^ EXT i ^ ^ 



where A is an action or state, B designates an attribute scale or an 
open interval on an attribute scale, and the relation MAN E7T i 
assigns property B to A. The index i can be 1 or 2 defining the 
relations corresponding respectively to the relations EXT 1 and EXT 2. 

9-3 Logical Structure 

9-3.1 General considerations . The logical structtire of a text 
represents in the form of a directed graph a network of binary 
relations defined on pairs of propositions which are themselves repre- 
sented as relational structures in the semantic structure graph. 
Relations defined ^in the logical structure represent a. number of sorts 
of connectives including conditional relations which render a propo- 
sition's truth value conditional on the validity of other propositions 
order and proximity relations which constrain the values of attributes 
loca.tions, times, degrees or manners for which a proposition is true 
by making these values relative to values specified in other proposi- 
^+--ions; and algebraic relations which may be used in conjunction with 
i¥/-?lations of order, proximity, and equivalence, to constrain ■ attribute 
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values. Conditional connectives may represent relations of logical 
implication, contrafactual conditional statements in which the contra- 
positive is not necessarily valid, and causal statements which represent 
causal relationships which are not necessarily proximal in nature and 
hence Cannot he represented in terms of case relations. In general 
the relations repre.<tented in the logical structure operate on the 
propositions contained in the semantic structure hy /specifi^ing inter- 
propositional constraints which restrict the conditions under which the 
propositions of the semantic istructure are \^lid. the present analysis 
identifies and defines a, number of logical relations which appear to 
be necessary to represent natural language discourses. The set of 
relations defining the present logical structure and the operators 
to he discussed in the follo\^ing section together define a. set of 
logical elements which may not "be represented in terms of any two- 
valued logic based on first order predicates. Indeed, in addition 
to requiring a logic which allows for n-order predicates and for 
statements which vary in probability or degree of confirmation, these 
elements require a logic which treats contrafactual conditional 
statements and what Rescher (I96U) has called belief- contravening 
suppositions, causal orderings, and- relations defined on propositions 
which are themselves inherently probabilistic or imprecise (e.g., 
propositions involving the relations EXT 2, NUM 2, DEG 2, LOG 2 
TEM 2) . 10 ^ ' ' 

9;3-2 Conditional relations . Logical relations which may occur in the 
logical structure graph are listed in Table 9.2. The listed logical 
relations are classified as conditionals, order and proximity relations, 
relations of . conjunction and alternation , exhaustive differentiation, 
and algebraic relations. Relations of conjiinction, alternation, and 
exhaustive differentiation are, with the exception of exclusive 
alternation, represented structurally in the semantic structure graph. 
Hence, no specific designated relations appear in Table 9l 2, Six types 
of conditional relations are defined: logical implications, bidirec- 
tional implications, contrafactual conditional relations, causal 
relations, definitional relations, and dis juriction. An implication is 
a valid material conditional statement. Thus, the conditional 
statement 

"if then P^" (p^ ^ -> Pg) 

, is valid, and the contrapositive statement 

"if not P^, then not P^" (-p^ ^ ^> _p^) 

is also valid. A "bi directional implication is the conjunction of two 
implications: 

IF T'R 
Pi > P2 ^nd p^ ±£ ^> 

and may be stated "p^ if and onJ;y if p^" (p^<^^^^ > p^). 
A contrafactual conditional statement 

COMD V 
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Table 9.2 

List of Designated Connectives in Logical Structure Graph 
Conditionals 



IMPLICATION 



BIDIRECTIONAL 
IMPLICATION 

CONTRAFACTUAL 
CONDITIONAL 



CAUSAL 

DEFINITIONAL IFF 
DISJUNCTION 



material conditional, "if A then 
& "if -B then -A" are valid 



material biconditional 

"A if and only if B" - . 

contraf actual conditional , 
"if A then B" -is valid, ' 
contrapositive , "if -B then -A" 
may not be valid" 

contraf actual conditional , 
temporal order (see text for 
other defining characteristics) 

identity in semantic structure 
\ 

there exists no valid conditional 
connective 



<- 



IF 



IFF 



COND 



CAU 



DIS 



-> 



Order and Proximity Relations* 



STRONG ORDER 
RELATION 

WEAK ORDER 
RELATION' 

EQUIVALENCE 
RELATION 



transitive , asymmetric , 
irref lexive 

transitive , ant is'yrame trie , 
reflexive 

transitive , symmetric , 
reflexive 



STRONG PROXIMITY intransitive, asymmetric, 
ORDER irref lexive 



WEAK PROXIMITY 
ORDER 



intransitive , antisymmetric , 
reflexive 



ORDl 



TT 
0RD2 



TT 



-> 



-> 



^ EQUIV . 

■(1 ^ 

P--ORD 1 ^ 

P--ORD 2 ^ 



PROXIMITY 
RELATION 



intransitive, symmetric, 
reflexive 
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Table 9.2 (Cont. ) 



III . Conjunction and Alternati on 



OR: UNION - 
INTERSECTIOI 



exclusive alternation 



0R:[P^,P2 



5 • • * 5 




& OR: UI^IQN" 



nonexclusive alternation 



&r INTERSECTION conjunction 

IV. Exhaustive Differentiation 

V, Algebraic Relations 
ADDITION 
DIFFERENCE 

DISTANCE symmetric relation satisfying 



*If an order or proximity is preceded by a " . then the 
asserted reiatiori is only an approximation (e,g*, 
EQUIV means approximately equal.** 



positivity, distance from any 
point to itself is zero, triangle 
inequality 



ERIC 
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is a statement of the form ''if p-^ ti?en P2" for which the contraposit ive 
is not necessarily valid. A contrafactual condittpnal statement m^y 
or may not be, belief contravening.. The contrafactual property-'of some 
conditional 'statements "(absence of a necessarily valid contrapositive) 
is due to the failure. to completely state all of the premises or hypo- 
theses upbn which the., validity of pg (the consequent ). depends , A contra 
factual- statement is belief contravening if it "draws a consequence 
from an anteniedent that^ is -in fact a belief -contravening hypo-thesis" V 
(Rescher,. 196if ,^-p... 25) " In Rescher^s (196U) analysis, the problem 
with contrafactual statements which are belief-contravening is that 
they are cont.extually ambiguous, i.e., accepting one proposition of 
a -^set of propositions leads,. to the consequence' that other propositions 
of the set may no .longer' be accepted and that .there is more than one 
..way in which the set of other propositions may be revised. Rescher's 
method pf solution of "the pfobleiii of contrafactuals involves the , 
extablishment of a principle of accepi:ance or. rejection based on an 
ordered property of the set of propositions such as probability of 
confirmation or causal ordering (in the case of causal contrafacturals ) . 

A causal relation connecting two propositions (causal contrafactual 
relation) , . • . 

• 1 , -^2 ' 

is a special case of a contrafactual conditional relation in which the 
relation possesses two properties in addition to. the defining properties 
of the contrafactioal .conditional relation. The two 'additional pro- • 
perties are: ^(l) the contrapositive of a causal relation is necessarily 
false., and (2) the order of the "antecedent" and "consequent" propo- 
sitions referred to in the triple 

CAU ^ • ■ ' 

5 Pi ^> P2 " . . 

is fixed by an established causally ordered (or. partially ordered) 
s^t of factual propositions describing, events or states: the ante- 
cedent proposition being a "cause" and the consequent being an 

^"effect." The set of causal];/ ordered propositions often will refer 
to a set. of events which are temporal];/ ordered (or partially tempor- 

, ally ordered). The' first property above referes to the require- 
ment that 

^ CA-J * ■ ' CAU 
P-j. • \ ^> p^ implies that not p^ > not p^ 

is necessarily false*. The causal .ordering referred to ' in" the second 
property is established by means of an analysis of the fimctional 
relations among all variables involved in the- events or states to 
which the contrafactual statements refer (Simon and Rescher^ 1966) . 
Such an analysis amounts to, an identification of a model describing 
a process within which the relation expressed in the causal contra- 
factual statement is to be interpreted, Ijf a relation is CAU then 
it will not be represented* as COND, i.e., COND consists of all contra- 
ractual conditional relations whicb^ do not satisfy the additional 
conditions of CAU relations. The following two sentences illustrate 
COND and CAU relations respectively T 
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1 If John goes to the store (p^)? he will not have enough 
money (pg). 

2a If John rixns too fast (pj^)^ he will fall down (pg)- 

Sentence 1 is a contrafactual conditional statement in t^hich the 
contrapositiye is not necessarily false. In sentence 2aj the contrapo- 
sitive is necessarily not valid ( Just as 

^2 ' — Pi 

is not valid), and there is a causal order established 'by an implied 
functional analysis based on elementary physical principles Sentence 
2a also involves a temporal order corresponding tp the causal order. 
Simon and Rescher," ( 19^6) have pointed out that the causal sequence of 
events expressed in sentences such as 2a may be expressed in reverse 
order as in 2b: "If John fell down, then he must have been running 
too fast" using the modal "must," "Must" used as logical necessity 
may be represented by indicating that there is a set of unspecified 
(deleted) propositions (^) which logically imply a proposition, i.e.. 



IF 



-> P 



1* 



Then 2b may be expressed 



where * refers to 



CAU 



->P2. 



In instances not involving a causal ordering, the unspecified proposi- 
tions^ will i-n general not "be 'identifiable in constructions involving 
"must." , Conditional relations are useful in the representation of 
other modals (e.g^. , "can," "ought," "should"). Since the qualifying 
probability operator (to be defined in the next section) is also 
involved in representing othei modals, they will be discussed in the 
next section. 

The remaining two conditional- relations are definitional IFF and the; ^ " 
disjunctive , logical relation DIS. • Definitions are represented in the 
semantic structure using the IDENTITY relation. The relation DIS 
connecting two propositions asserts that there exists no valid condi- 
tional relation Qomiecting'.the two propositions. DIS may be indicated 
in a surface , sentence by "even though" or "although." In most instances 
involving the relation DIS the speaker would be likely to assume that \ 
his listener would expect a conditional relation to hold (e.g., in . ^ 
"John went to the beach (p-j_) even* though it was raining (pg)" ' \ 

r DIS - •. ^ . ' 

one^ would be likely to expect that "since it was raining, John did not 
go to the beach" 

r com ^ — . . 

• [Pg ^> -PlJ- u 
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9.3-3 Order and proximity relations . Defining properties of order 
and proximity relations are suumiarized ^in Figure 9.2. Order and 
proximity relations are binary relations vliich connect pairs of com- 
parab.le propositions expressing certain attributive relations (EXT 2, 
LOG 1, LOG 2, TM 1, TEM 2, CAT 1, CAT 2), adverbial relations (DEG 1, 
DEG 2, LOG 1, LOG 2, TEM 1, TEM 2, MAN 1, MAN 2)", or quantifiers (NU4 1, 
NUM 2). Two propositions are comparable if they involve the same,, 
relations. The relations listed above are of four types which may be 
distinguished by the manner in which they assign quantitative (metric) 
values to the concepts they modify. ^ These three types are: (l) metric- 
assigning a point value on a metric scale to a concept (e.g. , NUM 1, 
DEG 1, LOG 1, TEM l), (2) stochastic:' -associating a probability dis- 
tribution on a metric scale with a concept (e.g. , EXT 2, NUM 2, 
DEG 2, LOC 2, TEM 2), (3) ordered class: assigning a concept to a 
class which is ordered r.e. other classes (e.g., CAT 1, MAN l) , and 
(k) classificatory : no metric properties (e.g., CAT 2, MAN 2). 
Particular order and equivalence relations must be defined with respect 
to each of these three types of relations. 

Three properties characterize order and proximity relations: transi- 

-tivity, symmetry, and reflexivity (c.f. , Coombs, 196^+). An order 
relation is any transitive relation connecting comparable metric, 
stochastic, or ordered class propositions. If an order relation is 
symmetric and reflexive it is an equivalence relation (EQUIV, e.g., 

. "equals")'- The negation of an equivalence reLation is the symmetric 
and irreflexive relation - (EQUTV) (e.g,, "unequal to"). If an order 

• relation is asymmetric- and irreflexive, it is a strong order relation 
(ORD 1, e.g., "greater than^'); if it is antisymmetric and reflexive 
it is a weak order relation ■( ORD 2, e.g,, "greater than or equal to"). 
Most order relations connect propositions asserting metric or stochastic 
relations (i.e., order' relations connecting ordered classes rarely 
occur since ordered classes appear to occur infrequently). Metric 
order relations are defined on the point values specified by the 
ccnnected propositions . In comparative constructions, unspecified 
point values are constrained to satisfy a particular order relation. 
For example, "John Is taller than Sally" constrains the degree of 
height attributable to John to be greater than that attributable to 

.'Sally while it leaves the values of these degrees unspecified. The 
example is represented as f ollovrs : 

r , EX T 1 ^ 4. DEG 1. ^ 

[ John ^> tall ' > X] ] 

[ Sally > ^ ^> tall > Y] <-J^^ ^ 

Stochastic order relations are defined on the distributions of values 
specified by the connected proposition-s , Note that the transitivity 
property of order relations will hold only approximately (or stochas- 
tically) for order relations defined on "stochastic propositions." 
Hence J the notion of transitivity must be replaced by the notion of 
stochastic transitivity in the definition of order relations.. Notions 
of stochastic transitivity have been utilized extensively in the study 
of preference among alternatives, particularly among alternatives 
which have multidimensional attributes which may influence choices 
(c.f. , Tversky, I969).. Stochastic equivalence will be defined as 
equivalence of the modes of the two distributions (i.e., the most 
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Proximity 



Order 



INTRANSITIVE TRANSITIVE 



SYMMETRIC 



REFLEXIVE 



IRREFLEXIVE 



ASYMMETRIC 



REFLEXIVE 



IRREFLEXIVE 



ANTISYMMETRIC 



REFLEXIVE 



IRREFLEXIVE 



^ -(PROX) ^ 



P-ORD 1 



-> 



P-ORD 2 



-> 



<- 



EQUIV 



-> 



^ -(EQUIV) ^ 



ORD 1 



-> 



ORD 2 
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Figure 9.2 

Properties of Order and Proximity Relations 
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probable values). rong and veak stochastic rder relations ma, be 
similarly definec .: example of strong stc hastic order rela: .on 
is the sentence: ... . _y is tall, 1 at John is " aller" vnich is repre- 



sented: 



[ Johr. "'^ ^ ' > tall .] — , 



[ Sail;,- ^ . > tall ] 



ORD 

< — I 



Sentences involving ordered classes must unequivocally treat the 
ordered classes as categories, e.g., as in "The tall girls are not as 
tall as the tall boys , but they are fewer in number." 

A proximity relation is any intransitive relation conne.cting comparable 
propositions. If a proximity relation is symmetric and reflexive it 
will be called a simple proximity^ relation' (or just a "proximity 
relation" if no ambiguty results) and denoted EROX, (e.g., "same as," 
"next to"). The . negation of a. simple proximity relation is the syiranetric 
and irreflexive relation -(PROX) (e.g., "different from"). If a 
proximity relation is asymmetric and irreflexiVe, it is a strong 
proximity order P-ORD 1 (e.g., "nearer to," "more similar to"); 
if it is antisymmetric and reflexive it is a weak proximity order 
(P-ORD 2, e.g. J "at least as similar as"). The intransitivi ty that 
is a defining property of proximity relations occurs when either (l) the 
attributive or adverbial relations asserted in the connected proposi- 
tions are classif icatory (non-metric) or (2) f^^e attributive or adverbial 
relations assign to their concepts a point in a metric space which 
has dimensionality greater than one (e.g., as in certain locative 
expressions). Examples of proximity relations (involving unspecified 
point values) are: (l) (PROX) "Your keys are with your wallet," 
(2). -(PROX) "Your car is different from mine," (3) ( P-ORD l) "The 
house is nearer than the church." An example of a stochastic proximity 
relatidn.is (k) "Your house is near > 'ut the church is nearer. 
Sentence (l) is reprer-nted: 

[keys ^> X] < , 



PROX 

[wallet — : ^ ^ ' — > Y] < 1 

The otht r examples ts: ,ng relati^-^r location require the algeibrai 
relation distance ar.i .v be discu::sed later. Examples of proximiT; 
relations involving rl:....:if icatory prepositions are: (PRO>) "John is 
married to Alice," ^ a cousin of Alice"; ( P-ORD l) ''John lik^-j 

cookies more than he ' .:?3 ice cream"; and (P-ORD 2) "John likes 
copkies at least as r^.^ .„ as ice cream." Examples of representations 
of these sentences . 



r T V. CAT 2 . . T ^ 

L John > cousin J <- 



[ Alice 0AT2 ^ cousin ] < — \ 
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^ , DAT ^ n . , 
John ^> likes 



OBJ ^ cookies ^ELi ^> x ] 



P-ORD 1 



OBJ ^ ice cream ^ ^> Y ] 



9.3.^ Other logical relations . The remaining logical relations listed 
in Table 5t2 define relations of conjunction and alternation^ .exhaustive 
differentiation, and certain algebraic relations. Exclusive alterna- 
tion is designated by OR followed in brackets by the list of propo- 
sitions to which OR applies. Nonexclusive alternation (&0R) requires 
no particular notation: it is assumed that at any branching point in 
the semantic structure graph, a structm^e containing any subset of the 
propositions is valid. Conjunction (&) is represented in the semantic 
•structure graph by enclosing the set of concepts or propositions 
whose conjunction is to be represented in a box. Exhaustive different 
tiation refers to situations in which the set of relations which 
differentiate a concept set are exhaustive, i.e., no elements remain 
in the set which do not belong to the subsets specified by the given 
relations. This situation is most likely to occur with collective 
nouns and is represented by introducing an additional relation 

CAT 2 ^ J 

^> p 

represents the null set). Algebraic relations may be defined on 
metric quantities to correspond to the familiar algebraic relations. 
The distance relation d is defined as any symmetric relation which is 
always positive^ such that the distance of any point to itself is 
zero, and such that the triangle, inequality holds, i.e., d (A,B) +. 
d (A,C) > d (AjC). The remainder of this section will illustrate how 
order and proximity relations may be used with the algebraic relations 
difference and distance to represent various statements of relative 
location and relative time. 

9*3.5 Relative location . Statements about relative location are of 
three principal types: relative position, direction, and orientation 
(Leech, I969). One sort of relative position, adjacency, has already 
been discussed (examples (l) and (2) on the previous page). Another 
sort of relative position^ relative distance, is involved in examples 
(3) and {k) on the same page.. Example (3) may be represented usin^^ 
the distance relation as follows: 



P^: (speaker ^^^^ ^> X 



^1 ' ^ » 

P : house LOG 1 . ^ V-OKD 1 



P^: Church ' — ^{0)' ^ ^ 
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Here, Pq is the point of orientation with respect to which the relative 
distance is measured. In example (i|-)*"Your house is i: ir, but the 
chiarch is nearer," "near" assigns to the distance 



< _^ 

a degree within an open interval and the proximity order is stochastic. 
Sentence {h) is represented: 



->P1 ] 



^2 ] 



DEG 2 



-> near <- 



P-ORD 



DEG 2 



-> near 



Statements of direction such as "The bird is above John'' involve 
establishing from a reference location a line or reference axis 
which is labelled by designating either the positive or negative 
direction (from the reference location) on the line. Thus in "The 
bird is above John," John is the reference location through which an 
(above-below) axis is established and on which the posi-t:ive direction 
relative to John is "above." The example is represented: 



[ bird 



[ Johr. 



LOG _ 
LOG 1 



-> above ]- 



ORD-1 



G 



]<- 



The relevant dimensionalit" of the locative relation i ": fixed at one 
designating the objects "1 rd" and "John" as falling on the line" for 
which John is at the .origir. . and the bird is .somewhere on the open 
interval "above." Since tiie dimensionality is one, the relation ORD 1 
applies. Statements of orientation involve such prepositions as 
"across," "through/' "beyor i," and "on this side of " as in the "The 
farm is beyond the village and "The house is across the road"; and 
establish an ordering of orjects in terms of relative distance .from 



a point of orientation (F,- 
Thus the first example it 

P^: (speaker)— 



along a line on which all 
represented: 



bjects fall. 



farm 



..OC 1 

Try- 



LOG 1 

~(Tr" 



-> 0 



"> f 



->P1 ] 



ORD 1 



-> 2 ]<- 



P^: village 



LOG 1 



-> V 



ERIC 



9.3-6 Relative time . Statements of relative time may be classified 
as before-after statements, statements ' of relative duration, and "while" 
statements (c.f.^ Leech, I969). Examples of before-after statements 
are "I saw him when he saw me" and "The final exam comes after the 
midterm." Statements involving measured intervals are also possible 
as "He arrived. five minutes after the lecture started." The general 
form for before-after statements is ' 



TEIvI 1 



TEM 1 



[ P. - Pn ] <- 



EQUTV 
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where R is an order relation and S-j_ and are propositions. The 
general form for measured intervals between events is 



units. The statement "She studied for a longer time than I" is a 
statement of relative duration. Such statements are represented using 
the relation 



TEM 2 



to indicate that S occurred during the +->^^ interval T, 
form for statements of relative duratior: . 



The general 



P-i : S- 



TEM 2 



-> T. 



TEM 2 



-> T, 



^2^ ^2 " 

where R is an order relation. "While" statements involve order 
relations defined on closed temporal intervals where the boundaries 
of the closed intervals may be unspecified. Examples are such 
sentences ar "She was at home while I was at the lecture" (co- 
extensive i :ervals of time), "When I looked uway, Soren grabbed the 
toy" (point lontained within a temporal interval), "John's ideas have 
changed sinz he went to the lecture" ("until" and "since"), and "John 
talked to us :;hile we were on vacation" (temporal interval contained 
within an interval of time). The general form of each of these cases 
is as follows: 

i 

1. co-extensive intervals: 



ERIC 



p. : > [t, , t J 



..p^: s^_^^l^>tt., t-] 



Pi <- 



EQUIV 



P-- 



1' "2^ -l^"l 
point contained within an interval:' 



p,(t, ), < ^> p2(t^) 



^ . ^ TEM 1 ^ , 

Pg* ^2 

"until" and "since": 



until p^: s^- 



TEM 1 



since 



^1 



TEM 1 



•Pi(t,) <- 



-> t. 



-> t. 



ORD 2 



ORD 2 



-> Pi(t2) 



TEM 2 



-> 



TEM 2 



-> 



present 
t. 



pre.gent 
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interval contained within an interval ; 
(p2^ and as in 1. above) 

ORD 1' . 
Pi — — > P2 

/ . N ^ ORD 2 ' , \ 

p^(t^) < ; r ) 



P 



The expression p^ (t-^) is used to represent the propositicc asserting 
that the interval of time given by started at time t^ snd P2_(t2) 
indicates the time at which the event ended. Interpretation of the 
example sentences in terras of their appropriate general frrms is left 
to the reader. 

9 • h Operators on Semantic and Lor .zs,! Relations 

:.4.1 General considerations . As -^ .s indicated ir. uhe ea:-.^ier dis- 
cussion of basic semantic propertie: of texts, the relation;^ repre- 
sented in the semantic and logical .-Tructures of a text may be 
tran^forraed or operated upon" in various ways. Particular properties 
of relations which may be transformed are truth-value, time relative 
to the factual present^ and completeness of a relational structure. 
Specific operations ori relations which effect these properties are 
identified in Table 9-3. . 

9.^.2 Operators on truth-value . Operations on truth \^iue are 
negation, denoted" -(R) , .where R is a relation to which operator 
is applied; qualification of a relax-ion, denoted QUAL(E and 
interrogation, denoted ?(R). The negation operator (trutn^value 
operator) applied, to a relation results in a propositior. '.^rhich is not 
valid. The operation of qualifying a relation (probabi ' ty operator) 
attaches to each proposition containing that relation a c^obability ^ 
that the proposition is valid. Probability operators are likely to 
be represented in the surface sentence by modals such as "may,'' 
"might," etc. Since different qualifying constructions in the surface 
sentence may result in different probability values (or distributions 
of probability values) the representation of the operate QUAL(r) 
includes the qualifying modal word X written in parentheses below the 
operator. Analyses of a number of modals will be presented below- 
The interrogative operator ?(R) interrogates the truth-value of the 
proposition containing the interrogated relation. Since it is also 
possible to interrogate a concept (see the essay which, is analyzed • 
in the next section for examples), two sorts of interrogation may 
occur. The interrogation operation may be expressed by prefixing 
"whe'ther'* or "whether or not," or by means of the interrogative trans- 
formation. Interrogation of concepts is expressed by means of 
wh-questions . . 



2i.k.3 Types of nep;ation . The operators on truth value, negation and 
qualification^may be used in conjunction with the negative qimntifier 



Table 9.3 

Operators on Relations in Semantic Structiire Graph 
and i'.onnectives in Logical Structure Graph* 

I. Negation of R&lation 

TRUTH -VALUE OPERATOR 



II. Qualification of Relation 



PROBABILITY OPERATOR 



QUAI.1? 



III. Tense 



TEMPORAL OPERATOR 



TEM(: 



IT 



IV. Deleted or Non-Specific Node 

NODE DELETION OPERATOR 



*(R) 



V. Conditional Truth-Value 



CONDITIONAL OPERATOR 



C0ND(K 



VI. Interrogated Truth-Value 

INTERROGATIVE OPERATOR 



"?(R) 



-> 



VII. Aspect 



ASPECT 



ASPCT(R) 



* X further designates the type of operator, e.g., X may be., 
^j^^. ^ qualifying T^ord, tense, type of conditional, etc. 
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and certain types of relations involving negative direction on a 
metric scale (i.e., NUM 2, EXT 2, DEG 2, LOG 2, TEM 2, in which- the 
reference direction is labelled (-) negative) to generate a classi- 
fication of types of negation (where by "negation" is meant that the 
resulting proposition expresses either a contradictory or contrary 
to another proposition which is construed as "positive"). This classi- 
fication is related to Clark's (1972) discussion of types of negation 
in English in which a distinction was made between explicit negation 
[which "can co^occur with 'any' in the same clause and with * either' 
as a final tag when' the negative is in the second of two 'and'- 
conjoined clauses" (Clark, 1972, p^ h2)'] and implicit legation (which 
cannot), and between full negation (contradictories) and quantifier 
negation (contraries). In terms of the operators and relations named 
above, a classification of types of negation can be made on the basis 
of (l) the type of negating operation: presence of a specific 
negating operator or relation vs. implicit negation given by a 
negatively defined metric scale, and (2) type of relation "operated 
upon": determinate (i.e., not stochastic) ' vs . stochastic. The 
classification is as follows: 

1 / negating operation : 

explicit negation: 



a. 



b. 



relational: 

conceptual: 

implicit negation: 
relational: 

conceptual 



- operator 

QUAL and - operators 

^ quantifier 

NUM 2 (-) quantifier 



["strong"] 
["weak"] • 
["strong"] 
["weak"] 



A R B (-) where B (-) is negative 
direction on B. scale and R is EXT 2 
DEG 2, LOC 2, or TEM 2 

A R B (-) where R is the quantifier 
NUM 2 which assigns negative direc- 
tion on the numerosity scale 



2 .^^ ^tiype of relation "operated upon " 



EKLC 



a. . full negation: 



b. stochastic negation: 



negative operator applied to a 
determinate (non-stochastic) relation 

negative operator applied to an 
implicitly positive stochastic relation 
(defined in the positive direction) 

Here "stochastic negation" corresponds to Clark's "quantifier negation." 
This classification results in the following types of negation 



1. "strong conceptual negation" e.| 

2. "weak conceptual negation" e.j 

3. "strong full negation" e.| 
k. "weak full negation" e.| 



"none," "no people" 

"few. people" 

"he isn't present" 

"he may not be present" 
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5. "implicit negation" e.g. "little " "below," "seldom" 

6. "strong stochastic negation" e.g. "not many," "not above" 
7.. "weak stochastic negation" e.g. "may not be many," "may 

not be above" 

9.'+.'+ Tense and aspect . As indicated in the discussion of the 
temporal relation TEM^ tense and aspect operators denote the time of 
an event relative to the factual present , while the temporal relation 
may specify either simple or relative time: relative to a point of 
orientation which may not coincide with the factual present. While 
tense and aspect can be represented struct"arally in terms of relations 
of relative time, to provide a sort of "shorthand" they will be 
represented by means of the temporal operator denoted 

tem(r) 

where R is a relation and 7 denotes a tense name ( viz . past, future); 
and the aspect operator 



aspgt(r) 



->, 



w 

where X identifies the particular aspect ( viz . Continuous, Completive, 
Inceptive, Cessive, Habitual, and Iterative) . If no operator appears 
on a relation, it will be assumed to be the simple present. Since 
the operators TEM and ASPCT can be represented structurally, they are 
fundamentally different from the other operators which operate on 
truth value. Particular tense and aspect operators will be defined 
in terras of their structural equivalents. The definitions follow: 

1. Tense: P^: A ■ -> t p^r speaker = > present (t^) 

^ EQUIV 

a. r>resent p < ^> r), 

— '^o ■ ^1 

. ' ORD 1 

b. past <— n 

^ -^1 -^o • . 

c. future p < t)-, 

-^o ^1 

2. Aspect . ' 

TEM 1 

a. simple "he walks" A ■ > t^ (present) 

TEM 2 

t). continuous "he is walking" A- ■ — >_..t^ (present) 



ERIC 



TEM ? 

c. completive "he has been wall5:ing" A ' — ^ ^> 
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TRM P 

'd. inceptive "he begins walking" A > 



(present) 



e- cessive ^'he stops walking" 



f. habitual "he always walks" 



t^ (present) 



A >t(EACH) 



TEM 1 

iterati ve "he repeatedly walks" P. : A > t, 

|1 / ] 



ORD. 1 

:2 



' TEM 1 
P^: A ^ ^> t 



t 

ORD. 1 



* TEM 1 




• TEM 1 

^ P : A ^ . > t 

- n [.!■ n 

■ p ^ ORD 1 p ORD 1 p 

1 o ,n 

9r^.5 Conditional and node 'deletion operators . The conditional 
operator COM)(R) renders the validity of each proposition containing 
the relation R conditional. on the validity of other propositions- 
The specific conditional constraints may be specified in the logical 
structure graph. If these conditions are not explicit, they may be 
indicated as unspecified (d.eleted) in the logical structure by means 
Qf the node deletion opei^ator *^(R) . Thus, in the sentence ."The 
satellite must return to earth," the specific conditions which' render 
it necessary that the satellite return to earth are unspecified. Tlie 
sentence is represented 

■ . ^..^ 

o where ^ refers to the unspecified set of conditions, the node deletion 
operator has been applied to the relation IF (i.e., the antecedent 

.conditions have been deleted), Pi is the , proposition corresponding 
to the sentence^ "The ^ satellite returns to earth," In addition to - 
the modals "must" and "have to" (as .logical necessity), the node 
deletion operator is likely to be represented' in the surface. >sentence 
in the form of impart iciples , gerunds, truncated passives, infinitives 
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e.g., deleted agent), and pronouns with' unclear antecedents. In 
addition, the node deletion operator is required in comparatives and 
in some statements of relative time and location. Often letters will 
• be used to represent the deleted node in the graph structures. . If 
the antecedent conditions are neither specified in the logical structure 
nor represented as deleted, a conditional proposition containing a 
conditional relation is taken to have hypothetical status. ^An hypo- " 
thetical proposition is considered to be true only for purposes of 
argument; it is neutral with respect to its actual truth or falsity. 

9.4.6 Modals To illustrate some uses of the operators -^^CR ) j QUAL(r)5 
and COKD(R) and to provide representations of sbme frequently occurring 
structures involving these operators, descriptions of logico-semahtic 
representations of some modal a\:ixiliaries which express possibility or 
logical necessity will now be presented. The modals to be considered- 
are "may," "might," "must," "can," "ought," "would," "should," and 
"could" as they express possibility or logical necessity. The logical 
structures to be considered may be classified as (l) those involving no 
antecedent conditions, (2) those involving \instated (deleted) ante- 
cedent conditions, (3) those involving unstated qualified antecedent 
conditions, and {h) those involving stated antecedent conditions. 
Within, each of these classes, the (consequent) proposition may be 
either unqualified or qualified. A list of the logical structures 
corresponding to this classification together with their associated 
modal expressions and an example of each follows: 



no antecedent conditions: 



a. unqualifi ed 
(consequent) 



R 



-> B 



b.- qualified "may," "might," 

(consequent) "can" (as possi- 
bility) 

unstated antecedent conditions: 



A QUAL(R) ^ g 



a. unqualified "must," ^*has to" 
consequent . 



^ MIF) (-^ COND(R) ^ 



b. qualified 
consequent 



"can" (as ability) 



COWL 
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QUAL 


a. unqualified 


"may have to 




*(IF) 


consequent 


"ought to," 
"should" 




QUAL 


b. qualified 


"may be able 




*(IF) 


consequent 


"ought to be 
to," "should 
to" 


able 
be able ■ 





COND 



h. stated antecedent conditions: 



230 



b. 



unqualified 
consequent 

qualified 
consequent 



"would," "must," 
"would have to" 

"should,", "might," 
"could" (as possi- 
biiitv^ 



V 



com 



.CONL 



-> [A 



[A 



coito(r) 

CONL 
Q,UAL(R) 



-> B] 



-> B] 



c . ability 

consequent 



"could" 



cor^D 



-> [- 



-(IF)- 



[A 



COND 
QUAL(R) 



-> i'] 



Sentence exampl^es of ' each logico-semantic structure are: 



lb He may go to the store (it is possible for him to go). 
2a TTrie satellite must eventually return to earth, (it is logically 
necessary) . 

2b He can lift the weight. ( There are conditions under which it 
is possible) 

3a The -satellite may have to retiorn-' to earth. (There may be 

conditions. .which render it necessary). 
3b He may be able to lift the weight. (There may be conditions 

under which it is possible), 
^a If he told you that, he v/ould be lying. 
hh If he told you that^ he might be lying. 

he If he were ten pounds heavier , he could lift the weight. 

Note that if sentence Ua were expressed as "If he told you that, he 
was lying." the' speaker has asserted both a proposition of type Ua 
and a proposition asserting that the consequent ("John was lying") 
actually occurred. H Finally, note that the logical structures 
listed under headings 2 to U above may be negated in more than one 
way^ i.e., if two relations are represented in the structure , either 
may be negated. This fact enables one to represent the differences 
between such sentences as "He doesn^t have to go": 

-■^(IF) 



•X- 



and "He mustn^t go' 



■X- 



*(IF) 



-> [A 



-> [A 



COI^D(R) 



COItD-(R) 



->B] 



-> B] 
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9-5 Analysis of an Essay on School Desegregation 

The discussion of semantic and logical structures and operators on 
relations represented in these structures has dealt up to this point 
pr"rcipally with representations of single sentences as propositions, 
and with logical connectives defined on pairs of propositions. This, 
section will complete the discussion of general principles for 
representing the semantic and logical structures of texts by 
presenting a detailed analysis of an example text consisting of an 
essay on school desegregation together with a description of additional 
principles which are required for representing those properties of 
texts swhich extend beyond sentence boundaries. Of specific concern 
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for an analysis of texts (as opposed to constituent sentences 
considered individually) is the establishment of principles related 
to three of the "basic*' prpperties of texts which were identified 
at the outset:, prinpiples for establishing lanique sequences of 
semantic relations which constitute a domina.nce order/ principles 
for establishing an hierarchical semantic structure (a "branching- 
tree^' structure) such that each branch constitutes an ordered 
sequence of relations, and principles governing the selection of 
inexplicit . inferrable semantic and logical relational structures for 
inclusion in the structural representation of a text. 

The analysis of a text involves roughly, the following sequence of steps 

] . Genera-'i' ion of a semantic I'epresentat ion of each constituent 
sentence 5 

2. identification of intersentential connectives and represen- 
tation of any logical relations which are defined on the 
propositions resulting from (l), 

3- identification of explicit .superordinate concepts , 

Identification of certain inexplicit structural elements 
including: 

a. -superordinate concepts which are necessai'y to complete 
the semantic hierarchy, 

b. deleted nodes in the semantic and logical structures, 

c. inexplicit elements in relative constructions (i-e,^ 
constructions involving order or proximity relations), 
and 

d. inexplicit inferrable semantic and logical relations 
connecting explicit concepts or propositions which are 
either necessary to complete the semantic hierarchy or ^ 

■necessary to produce a maximally connected logical or 
semantic structure graph, 

5* construction of the semantic and logical structure graphs 
from the results of the above steps • 

Each of these steps will now be considered and then the entire 
procedxxre v/iil be ij.lustrated with an analysis- of a sample essay. 

The' semantic representation of a.single sentence containing a verb 
phrase and noun phrases in various case relations to the verb involves 
first breaking the sentence into its verb phrase and noun phrase 
constituents ajid then identj.fying the case relations which charac- 
terize the relation of each noun phrase to the verb. Identification 
of case relations also involves identifying any relations whose 
associated concept nodes have been deleted (see the cucussion of the 
node deletion operator for examples). The order of '.he semantic 
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structure graph of the sentence follows the causal ordering described 
in the discussion of the case relations: the agent (or reflexive 
agent) precedes the -verb and other cases (which either explicate 
the action or are "resultive^' ) follow the verb and are not ordered 
among themselves. If no animate agent is reqired, the instrument 
(or reflexive instrument) precedes the verb. Noun phrases which 
follow the verb are not ordered. This partially ordered semantic 
structure corresponds to a basic sentence paraphrase: that paraphrase 
which is most closely related to the underlying semantic structure 
(and which presiunably requires less complicated rules of expression 
to generate it). Such a paraphrase will always be active and 
declarative. Nonspecified concepts will be designated by symbols and 
interrogated concepts or relations appropriately marked, A basic 
sentence is not necessarily affirmative or simple. It is often 
useful to generate such a paraphrase as an intermediate step in 
obtaining a semantic representation of a sentence. -At this'point in 
the analysis it is also der ' rable to adopt a single lexical designator 
for any concept which _.ccu- "epeatedly across sentences. Once the 
relations between the constituent noun phrases and the verb have been 
represented 5 the structure of each constituent phrase is represented 
using appropriate attributive relations, quantifiers-, or adverbial 
relations. Attributive relations are ordered only if changing the 
order does not result in an acceptable paraphrase. A constituent 
phrase may be replaced by an embedded clause which is itself 
represented structurally as an embedded proposition. 

Once the constituent sentences in a. text have been represented 
semantically 5 superordinate concepts are examined for all propositions, 
and superordinate concepts among them are identified. To obtain 
a tree-structure, it may be necessary to identify inexplicit super- 
ordinate concepts from which explicit concept sets' may be differen- 
tiated. Once the n'ecessary superordinate concept sets have been 
identified, .,the hierarchical semantic structure can be constructed. 
Solely to avoid triviality, the convention is adopted that the single ' 
left -most concept set be the smallest concept class- from which all 
concepts to the right of it in the hierarchy may be differentiated. 
The same convention is also adopted for subordinate' semantic hierarchies, 
In r pleting the semantic structure graph, other inexplicit concepts 
and ii:^lations may have to be represented, especially in representing 
deleted nodes and relations, relative constructions, and modal 
expressions. Each concept in the semantic structure is given a 
number uniquely identifying i'ts location in the hierarchy: as one 
proceeds from left to right, each "layer" of the tree is represented 
by an additional digit and within a layer , branch'es are numbered 
consecutively. For ease of identification , the first branches to the 
right may receive letters (as in the. example to be presented).' 

The nodes connected by relations in the logical structure graph are 
propositions represented in the semantic, structure and are denoted 
in the logical structure by code numbers locating the proposition in 
the semantic structure. The general form of the code is A( / 

Q ? 3 • * \) 3 where A locates the miain branch, the space before 

ER^C "^^^^ slash contains the number of the left-most concept contained in 
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the proposition, and the space to the right of the slash contains the 
numbers (separated by commas) of all terminal concepts in the proposi- 
tion. ^Represented first in the logical structure are all explicit 
conditional relations^ order and proximity relations, and other 
relations defined in the logical structure. In some instances, 
logical relations may be represented in the semantic structure as 
well, especially embedded logical relations and order and proximity 
relations occurring in comparatives. When the explicit lof^ical 
structLire is complete, additional inferrable semantic and logical 
relations are constructed which are necessary to produce a maximally 
connected semantic or logical structure graph. As the analysis 
proceeds 5 all relations are labelled and any operators on relations 
are marked. 

While the brief description just presented is intended to orient the 
reader to the steps involved in the analysis of a text, the method 
is most readily understood by working from a particular text to its 
representation. It is desirable that such an example be sufficiently 
complex to illustrate repeatedly a large number of points of semantic 
analysis which have been described in the preceding pages. The 
example text .vhose analysis is presented was used to develop scoring 
procedm-es based on the present semantic analysi^^ . In choosing to 
.work with a long and relatively "complex", text^ it was felt that any 
procedure which was capable of representing such a text would be 
likely to be applicable to most other texts. The essay which was 
selected is based on an '3ssay by Dodson (1963) entitled "On Ending 
DeFacto Segregation" and is a substantially edited version of that 
text. The essay is in eight paragraphs; the structure of each 
pararraph is represented for convenience in a separate Figure. Th.e 
text of the essay follows: 

1. Because the dominant people in a community are comfortable 
in their power role and becauF their status depends on the 
existing commionity structure , which they have created, they 
will not relinquish this structure without resistance. 
Therefore, a community coiifronting desegregation will 
necessarily experience conflict in some degree. Unfortunately, 
if a^commmity is not actually confrozited with desegregation," 
it will makd little preparation for desegregation and^ 
consequently will make J.ittle preparation for the conflict 
which desegregation entails. 

2. Wow, the question of who goes to school with whom is not 
decided by educators. This question is largely a political 
matter, and because it is largely a political matter, it is 
usually decided by lawyers, judges, politicians, and community 
leaders. If power , not educational merit ^ determines who 

goes to school with whom, then educators may study the question 
and interpret the decision, even if they cannot be the decision 
makers. / 

3. Since the initial stages of desegregation involve pressure 
groups which do not include educators, it is important that 



there be a clear statement of policy on desegregation, and 

it is important that this policy be rooted firmly in the 

authority of the community. In other words, educators need 

to feel "the support of the authority of the community and 

to feel secure that this authority is legitimate. In addition 

educators need to feel that the politicians are operating 

on their own initiative and not being pushed by pressure group 

Naturally, if groups who opposr desegregation feel that bv^ 
hollering they will get a hearing, they are going to holler- 
Therefore 3 implementers of public policy must move from a 
clear statement of policy on desegregation and must move with 
unequivocal mandates. Sometimes these mandates are from 
the State Department of Education, other times they are 
from the courts. At other times they must be wrought out 
of the heat of community controversy. 

Although educators do not decide the question of who is going 
to school with whom, they do have the responsibility of 
interpret ing educational matters to politicians. Therefore ^ 
educators must be clear about what they believe good education 
to be. Unfortunately , educators are ambivalent about the 
merits of a desegregated educational experience for all 
children as well as for black children. 

Further 5 educators are confused about the import of the de 
facto segregated school, Some educators believe there is 
nothing wrong with segregated schools provided that they 
are not zhe result of assignment because of race and provided 
that they offer as high a q^iality of education as do the 
other schccl.s which are not segregated. And they believe 
this even though there is little evidence to indicate that 
a de facto segregated school can be made equal in its 
educational program. If the entire community believe a "Jim 
Crov?" .mhool is inferior, then it is inferior. Therefore, 
the j'cquirement that a youth attend that school violates 
his ' ivil rights. 

As a last point j educators must possess more clarity about 
whe basic factors of growth and development. Some school 
systems capitalize on the disadvantages of black children 
V7hich ■ due to their traumas of the past, and group on a 
so cal. jd "ability basis/' thus providing a high degree of 
segregation. Psychologists have written perceptively of 
the art of matching up the maturation phases of youth's 
growth with experiences appropriate to each phase. Not the 
lea.st important of these phases of maturation is the develop- 
ment of self-other* It is important for a youth to know 
himself against other selves. It is also important for the 
range of that "self" to be increasingly widened. 

One of the major things children learn^in tpday's world is 
how to hide: how to hide in lily-white suburbs, how to hide 
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in homogeneous redevelopment projects. In addition, children 
learn how to hide in the neighborhood school. All of a 
sudden the neighborhood school has become sacred and the 
nearer black children get to it, the more sacred it becomes. 
The community school was never intended to be a "turf^' which 
shuts out life. However, it was intended to be a place 
where all the community's children would go to' school together 
The real issue before educators is how to lead all the com- 
munity's children toward real experiences with each other 
so that they develop the skills of citizenship commensurate 
with the times in which they live. 

The semantic and logical structure graphs for the essay on school 
desegregation are presented' in Figures 9,3-10. The left-most super- 
ordinate concept ( "comm-unities" ) is not represented in these Figures, 
The superordinate s'cructure is as follows: 

A 

TOK 



communities 



HASP 



-> .community 
C 

-> people 

HASP ^ . CAT 2 ^ ^^i^ , 
^ systems ^> schools 



The reader will note in studying the representation of this essay 
that the extent of the inferred structure which has been represented 
is minimal, being confined to that which is required to generate the 
semantic hierarchy and to represent certain regularly occurring 
structures involving inexplicit (deleted) elements. The inexplicit 
structure which may be represented is the set of all propositions 
inferrable from, the explicit structure. In general, such a structure 
is not likely to be representable in closed form. In addition, such 
an endeavor will inevitably lead to representing lexical elements 
semantically 5 thus leading us to depart from our more limited objective 
of representing only the "structural" as opposed to the lexical meaning 
of a text. However, it may eventually be important to incorporate 
more of the "inferred" structuj^e into the semantic and logical struc- 
tures. For example, it may be desirable to represent inferences 
which may be generated by a subject with high probability such as 
certain presuppositions and semantic representations of certain 
frequently occurring lexicai. items* 
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CHAPTER 10 

REPRESENTING LOGICO-SEMANTIC II^ORMATION 
ACQUIRED FROM A DISCOURSE 



10.1 General Considerations 

The purpose of this final chapter is to describe the application of 
the Staraantic model presented in the previous chapter to the base 
comprehension task, . Recall that the base comprehension task involves 
presenting one or more discourses to a subject and asking the subject 
to reconstruct that knowledge which he has acquired from the presented 
texts (when a presented text can contain structured deletions from its 
semantic structure). This task is actually much more general than it 
may appear to be at first glance. For example^ probe retrieval, 
verification, and question answering tasks may be analyzed as consisting 
of two texts, the text containing the target semantic information as 
the first text, and the probe, to-be-verified sentence, or question 
-as the second; and structural relations between the two texts can be 
represented within a single logico-semantic structural model. As a 
second example, many problem solving tasks require not only comprehension 
of the linguistic input which presents the problem, but also that the 
subject generate specified outcomes from the presented information. 
Such tasks may be conceived of as requiring a series of formal operations 
which result in a logico-seraantic structural link between one semantic 
structure, the ini^tial state, and another, the goal. Thus, it may 
often be possible (to represent the structural information constituting 
the problem and problem solution within a single structural model. 
In any of these variations of the base comprehension task, problems 
of logico-semantic .analysis of "discourse occur both in representing 
that logico-seraantic information which is (perhaps incompletely or 
imperfectly) coded in a discourse presented to a subject, -and in 
measuring semantic information which is linguistically coded in the 
verbal protocols which constitute the subjects' performance. 

The procedures discussed in Chapter 9 provide a means for generating 
a semantic model which represents the "structural meaning" of an input 
passage which is represented (for scoring purposes) in the form of 
two directed graphs: one representing the semantic structure and one 
representing the logical structure (see the example in Chapter 9). 
The scoring problem is, given this model, to measure correspondences 
^between the "meanings" represented by these graph-structures and the 
"meanings" conveyed by a subject's verbal reconstruction of the input. 
The scoring method which was developed involves two procedures: (1) a 
procedure for scoring reproduced or transformed semantic elements by 
"template-matching" to the structural model of the input, and (2) a 
procedure for scoring subject-generated semantic elements which do not 
represent reproduced or transformed input elements. To the extent that 



I 



252 



the definitions of the elements of the structural model of Chapter 9 
are explicit and that the rules by which they combine in the analysis 
of a specific text are clear, the principal scoring problems which 
remain involve the use of interpretive rules whereby a semantic 
structure is generated from surf.ac.e expressions and lexical substitu- 
tions* Since there is in general one surface expression in the 
paraphrase set f^or a given semantic structure which is most simply 
related to the underlying semantic structure (i.e. that surface 
expression which can be generated from the semantic structure by the 
simplest rules of expression), the simples t approach to the problem 
of generating a semantic structure for a subject's protocol appears 
to be to paraphrase its constituent sentences in such a way that the 
semantic interpretation is obvious. As experience is acquired in 
scoring, it will be found that this basic paraphrase step will becoii.: 
unnecessary, except for analyzing difficult portions of a passage. 
It is hoped that in the future, at least a part of the scoring 
procedure can be automated. What would be required is a computer 
program which would be capable of parsing and semantically interpreting 
(possibly pre-edited) English sentences. Thus the next step ought to., 
be to adopt a surf ace grammar and develop a set of rules of expression 
which are capable of mapping from surface expressions to semantic 
structures. At present, the scoring procedures require that the scorer 
know the semantic model, be able to generate basic sentence paraphrases > 
and be able to generate the semantic representation for the paraphrase. 
As will be seen in the section which follows, the scorer *s task may 
be simplified when the material which is scored consists of reproduced 
or transformed semantic information which is represented in the struc- 
tural model of the input discourse. It may also be possible to .simplify 
the task of scoring subject-generated structural elements, for example, 
by incorporating frequently occurring subject-generated information 
into the semantic model of the input, by providing the scorer with a 
dictionary of verbs which are likely to occur, a dictionary which contains 
a structural representation of the "case frame" for each verb, and by 
providing the scorer with a list of acceptable lexical substitutions 
for each lexical element of the input structure. 

The second and subsequent parts of this chapter describe certain conven- 
tions which were developed for scoring and representing reproduced and 
subject-generated structural elements in subj ects ' protocols . Dealt 
with first are methods for scoring reproduced structural elements by 
"templates-matching,'^* including such topics as criteria for paraphrasing,- 
fitting, scoring transformations of input structures, and marking the 
semantic and logical structure graphs which are used as scoring. sheets . 
Second, methods for scoring subject-generated structural elements are 
discussed including problems of paraphrasing, fitting subject-generated 
elements to the structural model of the input, the logical (inferential) 
status of subject-generated relations, and procedures for listing scored 
subject-generated elements. To illustrate the scoring procedures a 
portion of a scored protocol obtained for the desegregation passage is 
presented and analyzed in each section. The final section is concerned 
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with describing a method for the quantitative analysis of scored 
protocols which can enable one to test semantic-structural hypotheses, 
and with indicating certain directions in which research on comprehen- 
sion and semantic memory may go using the base comprehension task* 

10.2 Scoring Reproduced Structural Elements 

The reproduced structure consists of those parts of a subject's 
recall protocol which are either paraphrases of portions of an input 
discourse or transformed paraphrases of portions of an input. Thus 
the reproduced structure either has a logico-semantic structure 
identical to a part of the graph-structure of the input, or it may be 
transformed into an input structure by: (1) applying one of the 
operators defibed in section 9.4, (2) by modifying a quantitative 
attribute (viz. EXT, LOG, TEM, DEG, NUM, MAN EXT), or (3) by a 

mode shift (change of type of a relation (e.g. IF > COND) . .Ln practice, 

scoring reproduced structural elements is relatively easy: the repro- 
duced structure is scored dir ^.ctly on a copy of the graph representation 
of the input discourse. On these scoring sheets each reproduced concept, 
relation, or proposition is marked with a number indicating the serial 
position of the sentence in the protocol. Any relation which has been 
transformed by a subject by application or alteration of one or more 
of the seven operators is marked as so transformed. Scoring the 
reproduced structure involves principally a .process of paraphrasing a 
protocol to fit it to the structural model of the input text. With 
some experience, it becomes possible to fit directly (without the 
paraphrase step). The principal purpose of the paraphrase step is to 
facilitate identifying the graph-structure and matching the structure 
to the graph-structure of the input text. [To illustrate the procedures 
for scoring the reproduced structure, a portion of an actual recall 
protocol obtained from the desegregation passage is presented in 
Table 10.1, just as it appears in the computer listing (see the Appendix 
for a description of editing procedures and conventions for punching 
a protocol). This passage was selected because it consists mostly of 
reproduced or transformed structural elements. Paraphrases of the six 
sentences follow and elements of the semantic structure which correspond 
to each segment of the paraphrased text are identified immediately below 
the corresponding segment of the paraphrase. Notice that in the 
paraphrases pronouns are replaced with their antecedents, embedded 
clauses are enclosed in parentheses, words marking logical (interaen- 
tential) connectives ^re enclosed in square brackets, and certain 
lexical substitutions are made. We have been adopting a lenient 
criterion for accepting lexical substitutions, taking contextual 
determiners of the meaning of a lexical item into account. In many 
research applications or in the development of standardized tests, lists 
of acceptable substitutes for lexical elements in a text can be 
provided. The list of basic sentence paraphrases follows: 
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Table 10.1 



Protocol Obtained from Subject 101111: 
Desegregation Passage, First Six Sentences (trial 4) 



(BECAUSE THE DOMINANT PEOPLE WITHIN A COMMUNITY ARE COMFORTABLE 
IN THEIR POWER ROLES (BECAUSE THEIR POSITION IS DEPENDENT UPON 
EXISTING STRUCTURE (THEY HAVE BUILT ANY ATTACK ON THESE STRUCTURES 
WILL MEET CONFLICT/ 

THUS A COMMUNITY (CONFRONTS DESEGREGATION WILL MEET CONFLICT FROM 
THEIR DOMINANT PEOPLE/ 

(SINCE a. COMMUNITY USUALLY DOESNT CONFRONT DESEGREGATION THEY ARE 
NOT PREPARED TO MEET THE CONFLICT AGAINST THEIR CAUSE/ 

THE QUESTION OF (WHO GOES TO SCHOOL WITH WHOM IS NOT DETERMINED 
BY EDUCATORS/ 

IT IS A POLITICAL MATTER/ 

THIS MEANS (IT IS DECIDED BY POLITICIANS JUDGES AND COUNCILS/ 
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!• [Because] (a community's dominant people (pj) comfortable in 

their power roles) 

A(il211) 

[Because] ((pi have status) [depends on] (existing structure)) 
A(113) ( A(114111)^^«^> 

(p^ have built existing structure) 

A(114) > A(11411114111)^^-^^^ 

(any attack on existing structure) [will cause] conflict 

' A/^TTon\ COND r 1 *(MAN) EACH 1 CAU 

A(11211) — ^^^^^ > attack i ^ ^ ^ any J ^ conflict 

[A(114111)-^^A(113)] _J 

COND 

2« [JhtrS] (a community (which confronts desegregation) will experience conflict 

(which P2 produce ) ) 

A(31) A(511)(1^NC) 

3, [Since] (a community usually does not confront desegregation) 
QUAL 

\.l!£Vyi desegregation - A(41) <''^^'*> 

(a conununity does not' prepare (to meet the conflict)) 

A "^P^"^) prepare - '^^''^ > t community ^GT_^ ^^^^ __QBJ^ conflict] 

A(6) (OPER) (DEF) 



(the conflict is (* oppose the community's cause)) 

* *(AGT) . OBJ ^ , POSS V 1 

* > oppose >• (community > cause) 



conflict > 

(DEF) 

(Educators do not decide the question) 
C (1/131) 

(the question is (who goes to school with whom?)) 
C(99, 9.10/C(9911) ^ IDENT ^ C131 

(The question is political) = p 
C (9. 11/9. 11.1) ^ 
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6. [implies] (politicians, judges, and councils decide the question) 

C (3/311) 
C(4/411) 
councils AGT ^ C(31/311) 



The letter-number combinations designate substructures in the graph- 
structure presented in the previous chapter. All elements in the 
templates which are indicated by the symbols are marked with a number 
indicating the serial position of the sentence. Note that examples of 
transformations of operators occur ir entence three. All such 
transformations are marked on the gra^ix of the input structure which 
is used as a scoring template. The semantic analysis resulting from 
these operations results in a rather large set of possible measures. 
The scoring sheet in Table 10.2 classifies jsome of the possible scores 
obtainable from the reproduced, structure. The scqres in Tables 10.2 
(a)-(c) indicate the frequency with which each defined type of' semantic 
or logical relation has been reproduced or transformed, and how it was 
transformed. Also obtained for the semantic structure is a measure 
of the size of each complete sub-structure (in number of connected 
nodes) and the location of each sub— structure in the semantic hierarchy 
(level of left-most node) (Table 10.3). Since in the logical structure, 
a propositional node can be reproduced, can contain transformed 
relations, can contain deletions, or can contain self -genera ted 
elements (elaborations) , counts of reproduced or transformed logical 
relations must be classified according to the status of each proposi- 
tional node. The resulting measures indicated in Table 10 • 4 summarize 
the extent to which a person has reproduced and altered the logical 
structure in his reproduction. 

10.3 Scoring Sub j ec t-Generat>ed Structural Elements 

The analysis of subject-generated s tructure (i. e . , that which is not 
reproduced or transformed) proceeds in a manner similar to the analysis 
of an input text. The pr incip^al differences have to do with (1) 
procedures for mapping subj ect-generated semantic and logical relations 
into the semantic model of the input text and (2) conventions for 
representing the coded subj ect*-generated structure in list form- The 
coding of the subject-generated portions of the sample protocol of 
Table 10.1 is presented in Table 10.5 to illustrate the scoring 
procedure. A number of aspects ^of Table 10.5 require explanation. 
First, when a concept corresponds to a part of the model of the input, 
it, .is denoted by the letter-number combination which designates that 
part of the semantic model of the input (e . g . A(9/913) denotes "defac to 
segregated schools") . Second, single concepts which appear in the model 
of the input are circled. Third, to facilitate representation of 
embedded constructions, embedded subject-generated propositions are 
denoted by an "S" followed by at number. Fourth, each triple consisting 
two nodes and a connecting' semantic or logical relation occupies 
ERIC '^^^^ list. The left;,and right '^concepts*' are listed and 
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Table 10.2 (a) 
REPRODUCED STRUCTURE: SEMANTIC STRUCTURE 

Operators^ ( Totals ) 
CONCEPTS . Rep - Q * C ? TA Rep Oper 



Nouns 
Verbs 
Adj. 
Adv. 

(total) 

RELATIONS 
Attributive 
1. Ext 1 
Ex t 2 
Cat 1 



\ 



2. Ident 

3 . Poss 
Hasp 

(total) 
Quantifiers 

4. Num 1 
Num 2 
Tok 
Def 

Each 
(total) 



Cat 2 

(total) 



i 

Operators = operator applied or deleted 
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Table 10.2 (b) 
REPRODUCED STRUCTURE: SEMANTIC STRUCTURE 



Operators 

Adverbials Rep - Q * C ? TA 

5. Loc 1 

Loc 2 

Tern 1 

Deg 1 _ _ 

Deg 2 _ _ 

Man 1 

Man 2 

(total) • 

Active verbs 

6. Agt . 

Instl 

Dat 1 . 

Obj 

Source ._ 

Fac . '■ 

(total) __ 

Stative verbs " 

7. Dat 2 _ 

Obj 2 _ 

(total) 

8. Theme 

Goal _ 

. (total) 
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Table 10.2 (c) 
REPRODUCED STRUCTURE: LOGICAL STRUCTURE 

Operators ( Totals ) 

Conditionals Rep - Q * C ? TA . Rep Oper 

9. If 

Iff 

Cond 

Cau _ 

Dis 

(total) [ 

Order and Proximity 

10. Equiv 

Crd 1 _ 

Ord 2 

Prox 

P-Ord 1 '. 

P-Ord 2 

(total) ; 

11. Or 

And 

(total) . ^ 

Algebraic 
12. + 
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Table 10.3 
REPRODUCED SEMANTIC . STRUCTURE 

Number of Connected Nodes 

Depth 

3 4 5 6 7 8 9 10 11 12 13 14 

1 

2 , ■ ' ; 

3 . 
4 

5 " ■ . 

6 

7 

8 

9 

10 



Table 10.4 



REPRODUCED LOGICAL STRUCTURE 
Reproduced Logical Relation ; 

Prop 2 

Rep 
Rep Oper 



Prop I 



Inc 
Inc Oper 



Rep 
Elab 



Inc 
Elab 



(Totals) 



Rep 

Rep-Oper 
Inc 

Inc-Oper 
Rep-Elab 
Inc-Elab 



( uotals) 



Transformed Logical Relations ; 



Prop 1 



Rep 

Rep-Oper 
Inc 

Inc-Oper 
Rep- Elab 
Inc-Elab 



Prop 2 



Rep Inc 
. Rep Oper I'nc Oper 



Rep Inc 
Elab Elab 



(Totals) 



(totals) 























































































s) 
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Rep - Reproduced proposition 

Oper =5 Proposition contains oper relations 

Inc ~ Proposition contains deletic 

Elab PropoL ::ion contains elaborc ions 

Note: (1) Rep-Oper-Elab goes unae:r Rep-Elab 

(2) two entries in each cell: (a) upper left: cor Motional 
relations, (b) lower right: other relation^ defined 
in the logical structure graph. 
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Table 10.5 

Subject-Generated Structure: Protocol Presented in Table 10.1 



Sentence Left 
Number Concept 

1 A(11211) 



attack 



Right 
Concept 



t* 

any 
conflict 



inferential 



. on operators status 
COND IC 
CO^fD 



EACH 



CAU 



TEM(fut) 
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^2 = 



A(lll) 



produce 



conflict 



ACT 



FAC 



IC 



embedded 



A(511) 



OBJ 



A(41) 
community 



5 * oppose 



S^: community 



4 

meet 
conflict 



COND 
GOAL 
AGT 
OBJ 



conflict U:EF) DEF 



' IDENT 



^6 

cause 



OBJ 
POSS 
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consist of either letter-number combinations or a lexical element. 
The third column contains the label for the type of relation connecting 
the two concepts. Column four lists any operators applied to the 
relation and column five codes the inferential status of the subject- 
generated relation. Every subjects-generated relation is either inferred 
from jhe closed structure (i.e« is the result of applying rules of 
inference to the explicitly coded logico- semantic structure) , inferred 
from the open structure (i . e. valid inferences which involve semantic 
information in addition to that explicitly represented in the text) , 
or elaborative (all others). Note t'lat often a left concept is omitted* 
When this ocipurs the left concept is understood to be the right concept 
of the preceding line. This convention makes it easy to locate chains 
in the graph-structure, ... 

To further illustrate the scoring procedures which are utilized 

in analyzing the subject-generated structure, a poi tion of a second 
sample protocol is presented in Table 10.6. This sample protocol was 
obtained after one presentation of the desegregation text and is 
somewhat atypically difficult to code semantically since it Involves 
a very extens e subject-generated s true cure. The seirantic code for 
this protocol is presented in Table 10.7. The paraphrase step in 
the analysis ox this protocol has been omitted. The reader may verify 
the code of Table 10,7 as a way of making apparent the sort of judgments 
that are required in i^coring the subject-generated structure. 

10 . 4 Discussion 

In Chapter 2, two sorts of questions involving invar iances which are of 
interest for a theory of natural language comprehension were identified: 
questions concerning structural invar iance : the extent to which the 
struclzural c^ aracteristics of semantic inf ormation'^'acquxred from a 
discourse are fixed or .v-r£j riant, and process invar lance : the ex^-ant 
to which the sequence of processing operations which generate th^s 
information are fixed or Invariant. Both kinds of invariance can be 
consi ered with respect to discourse characteristics (surface and 
semantic) , character istics of discourse contexts, and other condit^-ons 
(such as temporal conditions ?nd repeated exposures to a text) , The 
strategy which was adopted in the present research was to attemp c to 
c — infer characteristics of discourse processing from' observations of 
frequencies of occurrence of particular classes of semantic response 
in subjects* V'ritten reconstructionn of 'knowledge acquired from a 
discourse. The focus in the preseu tit research has been on r ocess i.^.var- 
iance. Process invariance was investigated by examiii-^ng eifects of 
contextual conditions on the relative frequencies of particular classes 
of responses (Chapter 5). It was also found that by studying the 
statistical growth properties of these frequency measures , itr^as possible 
to make inferences concerning the temporal locus and role of particular 
processing operations in the acquicition of knowledge from discourse 
(c hapter 6) . 

ERLC 
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Table 10.6 

Protocol Obtained from Subject 101011: 
Desegregation Passage, First Six Sentences 



1. THE QU; JTION IS DEFACTO SEGREGATED SCHOOLS AND I'EIR DESEGREGATION 

2. EVERY POLITICAL ENTITY EVEN THE COMMUNITY IS CONTROLLED BY A LEADING 
GROUP WITH ESTABLISHED POWER 

3. THIS ESTABLISHED POWER GROUP SEEKS TO PROTECT ITS POSITION AND WILL 
BE UNLIKELY TO AGREE TO ANY MAJOR CHANGE IN THE COMMUNIH WITHOUT 
MUCH RESISTANCE 

4. INITIAL DECISIONS MADE CONCi-RNING SEGREGATED SCHOOL SYSTEMS ARE 
GOING TO BE POLITICAL DECISIONS THE OUTCOME OF STRUGGLE AMONC 
POWER GROUPS AND LEGAL AND JUDICIAL ARGUMENTS 

5. EDUCATORS mi LET THEIR BIFLUENCE BE FELT IN THESE INITIAL 
POLITICaI. DECISIONS 

6. THIS CAN BEST Bl .ONe' BY GAINING AN UNDERSTANDING OF THE COMMUNITY 
, AND ACTING WITH CONSENT OF THE AUTHORITY OF THE COMMUNITY 
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Table 10.7 

SEMANTIC CODTrlG: SUBJECT-GENERATED STRUCTURE 
Subject //f: 1-010-1-1 //I 

Sentence Left ^ Right inferential 

number concept "^ concept relations operators status^ 

1 , 

questlon(def ) SI IDEN IC 

SI: A(9/913) S2 AND IC 

S2: desegregate A(9/913) OBJ IC 





group 


power 


POSS 


IC 


54: 




. established 


EXT 


IC 






dominate 


AGT 


IC 




S4 


control 


AGT 


E 






entity 


DATl 


E 


S3: 




political 


CAT2 


E 






every 


EACH 


E 




S3 


community 


TOK 


10 



85; 



54 


seek 


AGT 


E 




S5 


GOAL 




84 


protect 


AGT 






position 


OBJl 




84 


position 


P088 




84 


agree 


AGT 


-TEM (f ut) QUAL (likely) 




change 


OBJl 






major 


CAT 2 






any 


EACH 






community 


LOCI 




agree 


resistance 


MAN2 






much 


DEC 2 





1, 

2, 



When a left concept is omitted, it is und5:rstood to be the ^ight concept 
of the preceding line. 

IC = inferred from the "closed structure/' 10 = inferred from the "open 
structure" (involves semantic information not included in the text), 
E = elaborated. 



Subject 1-010-1-1 y/1 



Tabi- 10.7 (cont'd) 
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SIO 



S61 



S6 

57 : 

58 : 



SIO 



S12 
S13 
Sll 



decide 



decide 



S6 

S7 

groups 

arguments 
arguments 



act 
A(8) 
SIO 
S91 



decisions 

initial 

systems 

A(9/91) 

political 

810 

S8 

power 
struggle 
legal 
judicial 
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comniunity 
S13 

consents 

S12 

Sll 

good 

*1 

*2 

=*=2(EACH) 



FAC 

CAT2 

THEME 

CAT2. 

CAr2 

CAU 

AND 

CAT2 

AGT 

CAT 2 

CAT 2 



S92 


educators 


let 


AGT 






S9 


GOAL 


S9: 


feel 


Influence 


OBJl 




educators 


influence 


POSS 






decisions 


MAN2 






political 


CAT2 






initial 


CAT2 






S92 


IF 


S91 


educators 


let 


AGT 






S9 


GOAL 




bei. ome 


understand 


FAC 



THEME 

MAN2 

AGT 

AND 

yiAJ.J2 

EXT2 

DEGl 

GRDl 

EACH 



TEM(fut) 



COND (must) 



QUAL (can) 



* 

•k A 
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It is also possible to Investigate in a similar manner hypotheses 
concerning structural characteristics of semantic information acquired 
from a discourse and concerning the s tructu^^.-^.l Invariance of acquired 
semantic information. What is required to pe-.nL ,t qualitative invest!-- 
gation of structural hypotheses is a connection between the order 
properties of the semantic Information represented in an input discc^urfiv 
and the order in which information is acquired from the discourse. 
An assumption which can make this connection is that the order of 
acquisition of structural elements is related to the form in which the 
elements are represented in long-te^m u^c^mory, i.e* to the netwoxr:- of 
structural relations connecting the elements. As an example of the 
sorts of structural hypotheses which can be, considered and the method 
by which they can be investigated, consider the following sentence: 

''John moved the new car from the road to the garage.'' 

The semantic structure for this sentence is (simplifying somewhat): 



John 
1 



AC] 



-> move 
3 



SOURCE 





OE 
> 




4 

FAC . 



> [car 
9 



LOG 
10 



road] 
11 



CAT 

> new 

6 7 

LOC 



12 



car 
'13 



> garage] 

14 15 



The numbers are used to designate specific elements (concepts or relatir.is) 
which are defined in the semantic structure graph. The response vector 
lL ~ ^^2.* • • * » ^15^ ^^'^ defined containing as elements the random 
variables such that Vi = 1 if a semantic ele. ent i is present in a 

subject's protocol and = 0 otherwise. If a discourse contains 
repeated instances of the above semantic structure, then response vectors 
may be pooled over ins^xnces yielding a score vector ^' = (y-^^ . . . , y-,c) 
which may be treated .is a continuous random vector which has the 
multinomial, distribution with mean vector y covariance matrix Z. Linear 
structural models expressing assumptions concerning he semantic structure 
may then be fit to this covariance matrix. 1 To simplify the example a^ 
bit more, let P2 = vg + v^q + vj^-, . (corresponding to the locative 
proposition "the car is in the road") and let P3 = v-^^, + V14 + vir 
(corresponding to "the car is in the garage"). laen che structural model 
■'.n the following diagr-im might be proposed to account for dependencies 
in the order of acquisition "of the semantic elements corresponding to 
the scores vi, . . . , V5, vs, vj2, P2> and P3; 
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V2 



r 

^2 



I 




^6 
I 


"8 


^ 


P2 








^ 1 








r 




t 


"12 




P3 


— 




t 

^8 



The arrows from to v and from C to v indicate that v is derived 

-L <^ X ^ 2. 

from and ^ by the linear equation V'^ = ^1^7 where a,, is a 

regression weight and is 3i random variable independent of . The 
above diagram Tray be represented by the following system of linear 
equations: 







^2 


a^v 


1 ^ 


^1 








^'4 = 


^3^3 








^3 = 


a^v 


2 












r = 

5 


"4^4 


^4 






^8 = 




3 


^5 








^12 = 


^7^3 












8 


^6 








F 


1 „ = 


^8^12 ^ 




in matrix 


form is 
















1 


0 


0 


0 


0 




0 


0 , 


0 ' 




V2 




ai 




1 


0 


0 


0 




0 


0 


0 




V3 




0 


0 


-^3 


1 


0 


0 




0 


0 


0 




^4 




0 


0 


0 




1 


0 




0 


0 


0 




^5 




0 


0 


-ar 


0 ... 


0 


1 




0 




0 


/ 


V8' 




0 


0 


0 


0 


0 






1 


0 


0 


P2 




0 


0 


-ay 


0 


0 


' b 




0 


1 


0 








0 ; 




0 


0 


0 

B 


0 




0 


-as 


1 

- J 




P3 

X 




0 

' r z 



8 



?1 

C3 
C4 
^5 
?6 
^7 



defining t linear structura^i model . In general the coefficient matrices 
B and r are (mxm) and (mxn) respectively. The coefficient matrix B must 
be nonsingular, and it is assumed that a mutually independent 



O and that the 's are independent of 
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and z. The general model also 
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allows that x and can contain errors of measurement. Joreskog and 
van Thillo have written a computer program which obtains maximum 
likelihood estimates of all parameters in any identif ia- i. : linear 
structural model by a series of numerical iteraMons an<^ :oraputes a chi- 
square statistic measuring the goodness-of -f it. of the model to the 
data (and permitting a sta. '.stical test of the fit of mode3, to data)^. 

Thus (in a manner similar to Chapter 6> by comparing the fits of 
alternative models it is possible to compare the ability of alternative 
semantic structural models to account for the observed data. If the 
above model fits data obtained for the exair le, it would indicate that 

one can regard the meaning as acquired in che order agent > verb 

followed by source (prior state) , object ^ and factitive result (where 
the latter three cases are not ordered among themselves). By generating 
and fitting linear models such as these, it will be possible to answer 
questions such as: "Does the dominance order specified by the semantic 
model predict probability of recall?'' "Are there substructures in the 
semantic model which act as unitary factors (structural units) in 
predicting..probability of recall?" "Is the analysis of a sentence 
'verb-centered' In that the substructure: verb + 'case frame' (concepts 
connected to the verb by case relations + the connecting relations), 
acquired as a structural unit? Are structural units acquir^^d independently? 
Is the' semantic structure invariant over transfer Tiations of the surface 
sentences? Do contextual factors affect order of recall? 

The ioglco^-semantic structural model and the scoring procedures which 
have been described in Part I|I, when used in conjunction with the base 
comprehension task, appear to' provide a very generally applicable research 
tool for studying the acquisition of semantic knowledge from natural- 
language discourse. Directions for future research employing the base 
comprehension task which- appear to be particularly promising are: studies 
of the effects of surface and semantic properties of discourse on semantic 
:^aforraation acquired from the discourse, studies of effects of semantic 
informatiOD acquired prior to the presentation of a discourse on the. acqui- 
sition of new information, additional stuaies of contextual determiners 
of discourse processing, and extensions of the research to developmental 
studies of processes of discourse comprehension and semantic memory. On 
the basis of the results obtained in the present research, there appears 
to be . substantial evidence which is consistent with a view of discourse 
comprehension as a complex series of processing operations whereby a 
listener attempts to infer that conceptual and relational information, 
which a speaker is attempting to communicate , from surface utterances 
which incompletely and falllbly represent that information. If such a 
conception of discourse p ocessing is valid, then there is good reason to 
expect tha^ substantial developmental changes^ occur well after the initial 
period of language acquisition (during V7hich most grammatical knowledge is 
acquired) has been completed, changes in the sequenc of processing opera- 
tions which enable a listener to acquire knowledge from discourse. 
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SCORING HAl' AL FOR REC.VLL 
PROTOCOLS ■ JED IN PAR" I 



I. Editing^ Codings and Linguistic Scoring Procedures 
1. Editing Qf Protocols for "Computer Counts 



Read through each trial of the protocol, corre'^t G^.elling ^^-..ei ^ is - 
necessary for understanding. Ma.: off all independent clauses 'i; .1 
a slash (/).. *rhe slash should precede the conjunction. Mark z e 
beginning of all subordinate (c^prndent) clauses with an open paren- 
thesis. 

An independent clause may be the main clause in a complex sentence 
(a sentence composed of two or more clauses); one of several main 
clauses which are independent in the sense that they could stand alone 
as a sentence, but the subject has Joined them to another clause with 
a . conjunction (usually ^'and'^ or "but"); or a simple sentence. See 
example below. 

See p. of ABC En ^ ish Us a. - "^or ? definition c" a S" 
clause . I — . -:ructic . .: constructions :-'ing geruna^ and 

partic^pi s g-^.'- t^he scorer che most trouble. Use the original 

passage as a guide-~this has been marked for clauses. 

EXAMPLE: 

Their chief opposition came from the ranchers (who said (that (if 
the farms grew there would be less land to raise cattle on (and 
Circle Island would not be able to keep up with its imports/ and 
they also argued (t? t more goods would not help (because the , two 
countries (that traded with Newhampton and New Beaton did not need 
fam goods/ They brought the issue to a vote (with the ranchers 
voting aginst the canal/ Everyone else voted for it/ 



A Fragment is to be treated as an independent clause, but asides are 
to be deleted. 

EXAMPLE: There were two^ m^ybe three/ 



Punctuation 3 except for the slashes and parentheses, are to be deleted. 

EXAMPLE: The farmers can*^ export anything (because the farmers ^land 
is small)^^the farmers raise only enough for their family/ 

2. Coding of Edited Protocols 

Punch cards 5 beginning the protocol with card column 1. Punch the 
entire protocol as the scorer has corrected it. The only punctuation 
to be typed in is as follows: 



marks end of independent clause 
marks off subordinate clauses 
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4) if a word must "be divided because you have punched to the 

end of a card^ be s-ure to leave last column for then 
continue with the remainder of the word ir column. 1 of 
■ the next card, 
^ . marks end of trial 1 
marks end of trial 2 
marks end of trial 3 
"^•^-^ marks end of trial h 

■^^^ marks end of delayed recall trial. When you have 

punched an entire trial, begin next trial with a new 
card. 



Hec^der Cards : 



ERIC 



These are subject identification cards. One card is to be punched for 
each subject and should precede the protocol cards for that subject, 

CARD COLUMNS 

1 . 2-5 6 7-8 9 10 ■ 11^12 

(Group) subject sex age class English Age learned Eng, 

1=A number 1=M l=F 1st Lang.? (if col. 10 is 

2=B 2=F 2=S l=:No Yes, leave blank) 

3=C 3= J 2= Yes 

3* Identification of Farts of Speech 

On the print-out, identify the following parts of speech (vrite in 
the symbol for the pert .of speech above the word to which it corres-^ 
ponds on the print-out): 

Symbol Part of Speech 

a article (the, a, an) 

d adjective 

B adverb (except those classified under j below) 

P pronoun 

R preposition 

N noun 

V vei^b 

c conjunction (except those classified under J below) 

J causal conjunction, causal prepositions, and con- 

junctive adverbs that signify a causal relationship 
between sentences, clauses or phrases. j's^' are: 

therefore as 
so thus 
as a result 
because 
since 

c on o o que n t ly 
9^- for 

due to 
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J 

EYjXIAFLE: We are going now, for we do not wish 
to be late. . j 

There were few ri^^ers; hence a shortage 
of water , 

^There may "be words other than those listed, which 
function in a causal way. 

Section 7 contains a copy of the original passage which has been 
edited and marked for parts of^spp^ch. 

The easiest way to accomplish the identification of all parts of speech 
it to identify as many as possible^ leaving small circles above those 
which you don't know or about which you are not sure. Then check the 
dictionary and the ABC of English Usage to identify those words with 
circles above them. . Simple verbs only are to be counted. When there 
is a complex verb, mark it as follows: 

P , V 

he will have gone_ 

p V n R n 

he is^^^ having pie for dinner 

Gerunds and participles are to be counted as verbs when they are used 
with verbal force but not when they are used in the sense of nouns or 
adjectives : 

d N 

dying swan 

N V d 

swimming is fun 

V N V d N 

Laughing , John took her hand 

Infinitives are to be marked as verbs, as follows: 

P V V 
They began to ri:in 

h. Tallying of Transformations 

Tally the passive transformations, negative transformations ^ and passive 
plus negative- transformations in the protocol. 

EXAMPLES: 

Passive 

The decision was reached to build a canal. 
The decision was reached by the senators. 

Negative 

Water wo>.iid not flow into the canal. 
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Passive plus negative 

The decision was not made oy the senators. 

Note: If there is a compoimd sentence (two or more independent clauses) 
or a complex sentence (embedded subordinate clauses) count one for each 
type of clause that occurs. If there is. a compound verb, count each 
verb transformation. 

EXAMPLES : 

The decision was made/ and the notice was posted/ (Count as two 
passive reansf ormations ) , 

The decision ( which was not reached in the first meeting was 
finally made tonight/ (Count as one passive plus negative, and 
one passive). 

The letter was written and mailed on the same day/ (Count as two 
passives), 

^. Tallying of Ambiguities 

Check protocol for ambiguities* Ambiguity is defined as double (and 
therefore doubtful) meaning in a sentence. ■ Mark ambiguities arising 
from: 

1. Incorrect position of a word, phrase, or clause. 

EXAMPLE: Choose the poems from the green book(whic^ I told 

vou to read (what does the adjective clause qualify-- 
poems or books?) 

2. Confusion of pronouns, ■ 

EXAMPLE: He told him(^ was selected to play (who was 
selected--the speaker or person spoken to?) 

3. Through double meaning in words themselves. 

; EXAMPLE: The sailors liked the ^;^ort)" (wine or harbor?) 

h. Unclear antecedent. 

EXAMPLE: I like the book and the pen.^(lt)is mine. 

Do not dwell overly long on this step. Pick out those ambiguities 
readily apparent in one reading. If the meaning is clear from the 
context 5 do not count an ambiguity arising from example 3 (above). 
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6> Additional Linguistic Scoring Instructions 
1* Write your name on print-out. 

2. I.f you find misspelled words (too many or too few letters) that were 
missed, circle the word in red and put a check mark in right margin 
by the line on which it appears . 

3- If you find dependent or independent clauses which were missed, 

pencil in the appropriate mark in red where you think it should go 
and put a check mark in the right margin by the line in which it 
appears . 

Parts of speech should be marked .with a No. 2 pencil, passives 
checked in red, negatives checked in blue, and ambiguities circled 
with a Ko. 2 pencil. If you have ajay questions, leave a large 
check mark in pencil above the word that is questioned, plus a very 
large question mark on the outside of the print-out to indicated 
that it is incomplete. 

5. Things which denote nximber may be nouns or adjectives 

e.g.: enough more 
one much 
most 

6. The following are pronouns: 

all 
some 
other 
none 

7. "all the : "all" is an adjective. 

7 Scored Input Essay 



•Circle Island is located in the middle of the Atla.ntic Ocean, 

north ox Ronald Island/ It is a flat island with large grass meadows 

u A ' , P A-'' C A' C li cc^ ' 

(called pampas/ It has good soil, but few rivers and hence a shortage 

of water ' 

The main occupations on the island are farming and cattle ranching/ 

In^eneral^ the farms of the island are small, designed mainly to ^eed 

A.' a ^ M . A' ^ V /: ^ /P 

the farmer and his family/ The ranches, less affected by the lack of 

A/ \y U t/ ^ a' P d 

wa.ter, are large enough to permit the ranchers tq^export much of their 
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beef, (-which is a black angus variety/ In fact, beef is the only 
export of the is.land/ v^^iince th'"^ "herr; are much more prosperous 
(than the farmers, no ranc^ / 

The island is_^run deir All issues are decided by a 

// 'P^'^ / -'^ ^'^ ^ ^ 

majority vote of the islanders/ The actual governing body is a ten- 



man senate ^ (called the Federal Assembly , (vh,osc job is to carry out the 

will of the majority/ (Since 'the most desirable trait in. a senator is 

administrative ability, the senate consists of the island's ten best 

proven administrators--the ten richest- men/ For years, all senators 

^ // 
have been ranchers/ 

Recently, an island scientist, Dr> Carl Oliver , discovered a ^^heap 

method. of converting salt water into fresh water/ He called this method 

saline recycling/ Asaresult, some of the island farmers wanted to^ ' 

build a canal across the island (so that they could use water from the 

canal to cultivate the island's central region, (which is called the 

Queensland District/ Some of the farmers formed a prq-canal association 

and even persuaded a few senators to join/ 

' c /A /P ^ ^ d ^ P ^-^ A ' , P 

The main opposition to the canal idea oame from the ranchers, (who 
point^d^ut (that (if new farms deprived them of grazing land., they 
would not be able to export sufficient quantities vof beef to match the 

::^A ' ^ U A ' CA" (A^7 K 

island's imports/ Moreover, this deficit could pot be made up by 

^ , i ^/ A-" ^. ^jy' A-\ 

increased farming (because farm produce is not in demand in New Hampton 

C ^' , y a. /A P aA 

or in Beatons Island, (which' are the countries (with which Circle Island 
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can trade/ They also pointed out (^that a large canal would upset the 

A ' ]^ J ^ ^ ^ /^^ "^p 

island's ecological balance (because it would be a barrier to the 

several small species (which migrate seasonally across the island 

^ o6 c/^ - ' - 
thrQil)^ its central region/ 
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■ The pro-canal association, (calling themselves the Citizens 
Development Association , brought the idea of constructing a canal to a 

— 

vote/ ^ 

All the islanders voted/ All the meiriL rs of the pro-canal, asso- 
ciation and all the farmers voted for construction/ and everybody else 

voted against it/ The majority voted m favor of construction/ 

A' C V a ^ y 3 

\ The senate, however, decided (that it would be too ecologically 

dangerous to^have a canal (that was more than two feet wide and one 

foot deep/ (After starting construction,. on_such a canal, the island 

^ ■ ^ y ^ . ^; e ^ ' ■ c2> 

engineers found (no water would flow into it/ and the project hadM;^oJJ£^ 
abandoned/ Many of the islanders were angry because of the failure of 
the canal project/ It appeared extremely likely (that there would be 

a/ 



a civil war/ 
TRANSFORMATION: Passive 

Negatives 3 



Neg. + Pass. 



AMBIGUITIES . 0 



II, Semantic Scoring Procedures 

8. Relational vSymbols and SemsLntic- Scoring Principles 

Procedures for scoring the semantic or ideational content of each 
subject's protocol are to be described in the following sections. In 
general, these scoring procedures require an understanding of the 
relational structure of the "input^' text, a structure which is repre- 
sented diagrammatically in the large ohart reproduced in Figures 3.1- 
3,8. The semantic analysis represenl^d by this chart is based on- the 
fact that declarative sentences express aet relations--that is, they 
express a relation or relations between two or more denoted sets (also 
called concepts). A relational structure consisting of a network of 
set relations\ian be expressed linguistically in more than, one way; 
In order to understand the scoring instructions which follow^ it is 
first necessary to familiarize yourself with a number of diagrammatic 
symbols -used in this chart.. Semantic scprlsig will consist of para- 
O >sing (if necessary) the sentences in a subject's protocol to make it 
ERJC as closely as possible the semantic structure diagrammed in the chart 
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Relational, Structure 

. The large chart represents a diagram of the relational structure of the 
passage which was read to the subjects. Your Job is to familiarize 
yourself with this "map" and then employ it *^ n scoring each subject^ s 
written protocol. The following symbols are all used in the map; each 
Sionbol is followed bv its definition. 

1. A phrase de»^ cept or set, A concept may be a thing, event 
or attribi . e. ranchers 3" "prosperous," "voted." Note that 
in most ins concept appearing in the chart can be itself 
broken down into concepts and relations. A concept usually corres- 
ponds to the semantic subject of an independent (main) clause ^ 

a predicate 3 a location, a comparative cons^truction, or an embedded 
(relative) clause. FOR SCORING PURPOSES, EACH CONCEPT PRESENTED IN 
THE CHART IS TO BE TREATED AS A UNITY. 

2. A > B denotes an explicit relation: any directed relation 

which- is explicitly stated in .the original passage* This symbol 
should be read: "A has property B" where the property may be a 
state or a role in an action. Relations: (l) specify states such 
as: location, time, attributes, possession, class membership, . degree 
and manner, and (2) specify relationships involved in events such as: 
agency, instrumentality, object affected, person affected, goal of 
an action, resulting state, and thematic- content . These different 
sorts of relations are not differentiated in the diagram. 

<; ^ g denotes an explicit identity relation: an identity 

relation which is explicitly stated in the original passage. This 
symbol should be read "A is identical to B." Concepts linked by an 
identity relation can be substituted one for the other. 

^4-. A > B denotes an. explicit ccnditional^relation, a reLation ' 

which asserts that the truth of one propg^ition is conditional on 
the truth of a second proposition which As explicitly stated in the 
original passage.. Read: "A implies B," "A causes B," or "B is 
conditional upon A." Usually an "if . . . then" cause and effect 
relationship between two propositions * In the map, conditional 
relations are drawn connecting the terminal concepts of their 
respective propositions- 

.'■5 

5. A <-===> denotes an explicit bi-directional implication, i.e., a 
bidirectional logical implication which is explicitly stated in 
the original passage. Read: "A implies and is implied by B." 

6. A > denotes an inferred relation, i.e., a relation which^^ 

while not stated directly, is necessarily true within the context 
of the passage. 

7- A = ~ =v> B denotes an inferred conditional relation, i.e., a 
conditional relation which, while not stated directly, is 
necessarily true within the context of tho passage. 
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8. A ==-^> denotes an inferred bi-directional implication^ i.e., a 
bidirectional iiAplication which is not explicitly stated, but is 
iiecessarily true' within the context of the passage* 

9. is occasionally used to enclose elaborative relations, 
conditional relations, bi-directional implications, or 
concepts which are not necessarily true (within the context 

of the passage) but itiky be added to the essay without contra 

.dictirr^ rplat or implications stated r implied by the essay. 

-tions, and bi-directional implications so enclosed 
arc .s.,.. ..^.ig the dotted symbols (6), (7), and (8), respec- 

tively, A few elaborative relations, conditional relations, or 
concepts are included in 'che diagram. Many more are. possible and 
likely to occur in subjects* protocols. 

10. When a concept or part of a concept appearing on the map is enclosed 
in parentheses (), then the attributes or actions denoted by the 
enclosed words are considered to be optional (and not to be scored). 

11. Words enclosed in quotation marks on the map are verbatim items 
embedded in other concepts . The verbatim words do not have to be 
there. However, the subject must indicate something is there, 
e.g., North of "Ronald Island"--the of is essential to the concept 
because it indicates that the subject knows that the location is 
north of some other place. 

To make certain that you understand the symbols and their use in 
the map, read through -fche essay Circle Island once, then read 
through it again sentence by sentence while, at the same time, 
locating each concept and set-relation on the map. Make certain 
that you understand just what words denote each concept and each 
relation or implication. Also, locate each inferred concept and 
set relation. on the map, and verify that it is in fact inferred 
(i,e. , necessarily true within the context of the essay). Finally, 
. try to think of additional concepts and relations which are examples 
of inferred and elaborative. concepts, relations 5 and implications 
and which are not already diagrammed on the map. 

The "map" which you have been studying represents a relatively 
undetailed specification of semantic • structural relations present in 
.the input passage entitled Circle Island. A more detailed "map" would 
further break down the "concepts" into set relations. The problem of 
scoring semantic or "ideational" features of a subject's written 
reconstruction of this "input" essay will be treated by referring to 
the model of the input provided by the map. Scoring procedures will 
involve separately scoring different logical features of the subjects' 
protocols in terms of cprresponding par1;s of thi^ model. We have 
already distinguished .between explicit, inferred, and elaboraltive 
concepts, and. explicit, inferred, and elaborative relations, conditional 
relations^ identities, and bi-directional implications. From the 
diagrMomatic model, the concepts and set^relations expressed in the 
original passage may be reconstructed. On the scoring sheets, each 
nnnnept and relation on the map -will be identified by ^ code number 
ERXO ^^^^ scoring subject ' s protocols by reference to the map. 
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The sema .tic scoring of subjects' protocols involves three steps: 
verbatir coring, concept scoring, and relations scoring. In each step, 
one type f element will be considered. Each element will be scored in 
terms o: occurrence of certain logically possible transformations 

which th ubject can make on an element of the input. Thus, for 
example, tne concept "affected less by water shortage'^ may be correctly 
present in a subject^ s written protocol, maj^ be incompletely specified 
by the subjject (e.g., effected by water shortage")^ may be overspecif ied 
by the subject (e.g., "were desperately in need of water"), or may be 
entirely absent. Each of these cases represents a transformation of 
input information by subject. - ^ ■ 

9> Verbatim Scoring Instructions 

Verbatim scoring of a subject's protocol involves first reading the 
protocol and underlining every item /of a fifteen-item list of verbatim 
concepts) which occurs in the protocol (see the verbatim scoring sheet 
which follows this section). Each verbatim concept is scored as 
either: correct (verbatim criterion, incompletely specified (if a 
portion of the verbatim concept appears)^ overspecif ied (if the .verbatim 
concept occurs together with additional extraneous specification) , or 
absent. Words in parentheses" on the scoring sheet are ignored in 
scoring the verbatim concept. , 

EXAMPLES:. "Dr. Carl Gustave' Oliver'* : scored A-, overspecif ied. 
"Assembly" : scored A-f, incomplete. 

If a verbatim concept is both overspecif ied and incomplete, it is 
scored as incomplete (e.g., "Rhode Island" : Ah-, incomplete). If 
^^Pacific" were present in a subject's protocol (and "Atlantic" did not 
appear), verbatim concept 3. "Atlantic" would not be checked. 
"Pacific" wc be scored later as an additional elaborative concept. 

Note the following rules: 

1. Phonetic spelling is scored correct. 

2. Change in the order of words is allowed. 

3* "Feet" can be written as "foot" and vice versa. 

In addition to these scores, the sequence number of each verbatim 
concept in the subject's protocol relative to other verbatim concepts 
is recorded in an ap_^opriate blank* Total verbatim concepts correct, 
incomplete, and overspecif ied are obtained and entered at the bottom of 
the scoring sheet. Repetitions of verbatim concepts are not coimted 
and repeated verbatim concepts are not scored. 
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10. Concept Scoring Instructions 
General description of scoring procedures 

. Concept scoring inyolves underlining and scoring each of a list of 
concepts -which appears in the original passage and which is numb.ered 
and diagrammed in the model. The scoring sheets contain a list of 
numbered concepts section-by-section* 
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Explicit, inferred^ -d elaborative concepts 

Every concept ^appearing in a subject's protocol will be classified as 
expliv.j.t^ inferred, or elaborative. A particular concept appearing 
in a protocol is classified as explicit if it corresponds to a numbered 
explicit concept on the map. An explicit concept may be scored present 
and correct^ incompletely specified (concept-set not completely 
delimited, i.e., includes subsets not corresponding to the concept-set 
of the input), or over-specified (concept-set overly delimited, i.e., 
represents a subset of the concept-set of the input)* Since the last 
two transformation of an explicit concept may occur, it is often 
necessary to consider the context (relations involving the concept of 
the protocol and those of the input passage) in identifying a subject's 
concept with an explicit concept in the input. 

An inferred concept does not correspond to any explicit" concept, but 
does enter into relati ns with explicit concepts which are necessarily 
true . . 

EXAMPLE: ''New farms reduce grazing land and result in less beef 

production. " Here 5 ''less beef production" enters into an 
"implication which is necessarily true but does not correspond 
^ to any explicit concept. Thus, it is inferred • 

Inferred concepts are scored as present only when they are identified 

in a subject's protocol.- Some inferred concepts are listed and diagrammed 

on the map; many will have to be listed separately. 

An elaborative concept is neither explicit nor inferred. Thus, an. 
elaborative concept enters into no relationships which are neciessarily 
true. • This "truth test*' criterion is used to distinguish between 
inferred and elaborative concep.ts. An elaborative concept is to be 
scored only as present (subject-generated) when it is identified in a 
subject's pirotocol. Most elaborative concepts will have- to be listed 
separately. 

Procedure for marking print -outs 

1. First, underline the -concepts on the print-out. It is helpful to 
underling the verbatim concepts in red and the other concepts in 
pencil. 

2. Number the concepts on the print-out ^as you number them on the 
scoring sheet,;( sequence numbers). This helps you to keep track 
of the seqiiehcing and in scoring the relations. 
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3» VJhen it is._. (difficult to decide how to score, a concept, circle it 
and make all your difficult decisions last. 

Definitions of scoring categories 

1. A (Correct) = Subject ' s._words are identical to or paraphrase those 
O listed for the concept. la the case of verbatim items, the subject's 

ERJC words are the- same as the listed concept (phonetic spelling accepted). 
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2. A> = (incompletely specified) = Subject's words denote a set which 
is more general than that specified by the listed concept^ i,e.j 
subject has left out words that are essential" to the concept 

and thus has not specified the concept completely. This category 
to be used for explicit concepts only. 

3. A- (over-specification) = Subject's words specify a subset of the 
set denoted by the listed concept, i.e., subject has added words 
to the listed concept, such that the meaning of the ^nr^--'* ■ 
altered by overspecif ication in such a way that ix^. .xth 
other concepts (as given by the map) are no longer all true. 

This category should be used as little as possible, and only for 
the explicit concepts.. 

Scoring Sheet 

1, Make a' check mark in the appropriate column and write the sequence 
niomber (serial position of the first occurrence of a concept in a 

1. subject's protocol) in the blank between the concept number and 
the c'bncept. 

2. List additional elaborative and inferred concepts on the last page 
of the scoring booklet. The rule to follow is: Fit a concept 
wherever possible to those already listed. When you have finished 
a trial, go over those elaborative and inferred concepts that you 
have listed as additional and try to fit them to nu^nbered concepts. 

3. " For repeated additional elaborative and inferred concepts, make a 

check niark in the coliomn for serial position, but do not give the 
repeated concept a sequence number. / 

Scoring map and passage 

It is a good idea to keep a copy of the. map and passage before you when 
you are scoring. These are necessary when jiidgments must be made in 
fitting a concept. 

Repeated concepts 

1. ;When a concept is repeated-, make another check-mark for it in the 

appropriate colimm. If a concept is checked in two or more columns 
(say A arid A+) circle the.-fdrst check mark made, i.e., the check 
mark that corresponds to the sequence number. When a concept is 
not renamed but is repeated as a pronoun, do not place a check 
mrk for the pronoun. 

2. Do not check verbatim concepts more than once, even if they are 
. repeated. 
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See item No. 3 under Scoring She^t for repeated additional 
elaborative and inferred concepts. 
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Arbitrary seimntic decisions 

1. When subject uses the article the wit.i generic terms (e.g., the 
ranchers 5 the farmers , etc.)^ or when only the generic term is used 
(e .g* 5 ranchers 5 farmers ) j the following scorinr rror^-iures shoi. i 
be followed: 

(a) where the listed concept uses ^.he plus generic term, or just the 
generic term, any quan-^r.if ication written by the subject should 
be scored as over~spec_f led (e g., all farmers, most farmers, 
jome farmers, e'^c) 

(b) " Where the listed conce':"^ uses a quantifier (all the farmers, 

some farmers, e ^.) the subJect^s use of the plus generic term, 
or just generic erm, should be scored as under-specified, 

2. Constructions such as 'No ranchers are farmers" are to be scored 
a~ "ranchers are not farmers.'^ 

3. Constrxictions such as "Only ranchers are senators'* are, to be scored 
as follows: 

(a) "Wo one but ranchers*' --inferred concepu 
"ranchers'* — explicit concept 
"senators"--expli^ . b coniiept 



PronovciS are not scored e>:.:ept in the following case: 

1. When the pronoun refers to a previously unscored concept, i^e., its 
antecedent is a concept whicii is embedded in another concept such 
that the antecedent was not previously scored separately but as 
part of the concept in which it is embedded — e.g., "(a scientist) 
discovered a desalinzation m:thod. It is called saline recycling." 
In this example the "it" ref- rs to the desalination method and 

you should score concepts Ncj. 71, 86, and 87. 

2. Sonietines a subject will wriT:e the following: "Some farmers 
vanted to build a canal acro_ 3 the island. They formed a pro-canal 
association." In this case, you should, score concepts Nos. 78 , 

79? 80, 8I5 and '88, because ^^they'* refers both to the "some farmers*' 
who wan'^ed to build the canal and to the "some farmers" who formed , 
the pro-canal association, 

Anibiguities 

1. Since we are not checking prcnouns, ambiguou_^ pronouns will give 

the ::oncept scorer no troubl . Howeye^^^, the:-- wi.ll give the relations 

orer trouble. If i.ne ambi.:ucus pronoun r.^ not already been. 
: Irc^ed on the prin-^ mt and cc rjited by thf linguistic -scorer 
p lease be sve to ci: le it m red and cha .ge the totals under 
O i^rabiguities . ** Also ^ rcle tha^". total ir 3d so the data cards can 
ERJCe changed. 
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2. Seinantic ambiguities vill arise -when the subject' refers to such 

concepts as '^the prc^r-^s" ^ "that idea" without haviricj previously 
identified, or riii,i> oioned e. .ocess or idea* When this occurs, fit 
the concept where you can and check the incomplete (A+) category* 
In some cases, it may. have to be listed as an additional inferred 
or elaborative concept; 

Identities 

V/hen a subject replaces a part of a concept with an identity (words 
replaced are shown on the map as equivalences), the concept should be 
r.Gored correct. 

ZiXAMPLE: "formed a Citizens Development Association," 

oncept No. 8l should be scored correct because "pro-canal association" 
and "citizens development association" are identities. The only 
exception is in the case when the identity -involved was inferred (not 
strLted explicitly in the original text). 

Apposition 

t^hen a subject indicates an identity by apposition, a part of a phrase 
denoting a concept may be scored, e.g., in "discovered desalination 
method saline recycling," concepts Nos. 7I3 86, 8? are scored. This 
is necessary because when the relations are scored, all three concepts 
must be scored in order to represent correctiy the relation^ that are 
mapped between these concepts. 

Quali f i cat i on 

If a subject qualifies statements which are not qualified in the 
passage*-using such words as "possibly," "might," "may," etc. --score 
the concept as correct. Conditional statements of an "if . . .then", 
nature will be handled in the relations scoring. ' " ' 

Changes in computer listing 

If you find it -necessary to look up a subject^s written 'protocol and 
to correct the computer listing of the protocol by adding or deleting 
words, be sure to indicate on the listing that it has been corrected. 
This is necessary to indicate that totals on the simple counts and 
linguistic scoring counts must be corrected. 

Scoring decisions 

1. When a concept fits both the incomplete and overspecif ied categories, 
i.e., something is added and something is left out, check the 
concept in the incomplete (A+) category.-^ 



^ NOTE: Only repeated concepts may be checked in more than one category, 
ERIC this occ^irs, be sure to circle the check mark that corresponds 

aaa^ta to the seque:i.ce number, i.e*, circle the first check mark that you make. 
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2. When making a decision regarding the fitting of the concept , the 
following procedures should be followed: 

a. Decide what the concept is. ; 

b. Decide what section it is in. 

c. Try to fit it to concepts in that section, 

d. If it seems *to fitmore than one concept, look at the context, 
i.e., the other concepts that are re3_ated to the concept in 
question* 

3. When you have difficulty deciding if a concept is present as an 
A- or or if it really should be written in as an additional 
inferred or elabor5>-^.ive concept, the rule to follow is--fit it if 
-possible to explicit .concepts, using the following guide lines for 
the overspecif ied category: . - 

(a) the test for the overspecif ied category (A-) is: does the 
overspecif ication change the meaning of the listed concept in 
such a way that it is recognizably the same concept, but the 
set denoted by the listed concept has been made smaller or more 
specific by the subject? If so, score the listed concept as 
overspecif ied (A-). Or is the complete listed concept there 
plus something additional ,such that the concept can be scored 
correct as listed, and the additional words be written as an 
additional inferred concept or an additional elaborative 
concept. - ; 

(b) Use the overspecif ied category and the incomplete category for 
explicit concepts only. 

(c) Use the overspecif ied category onJ-y where the pverspecif ication 
is clear to you. If you are in doubt, write the concept out 
under additional inferred or elaborative concepts and put a 
question mark by it. 

Difficult judgments 

1. Write in the subject's words next to the concept on the scoring ■ 
sheet when a difficult judgment must be made. This is the only 
writing that must be done except where it is necessary to list 
additional inferred or elaborative concepts. - 

2. If? Q.fter you have made your judgment, you still have doubts, put 

' • a question mark in the colimm to the extreme left (section column) 
and someone will double- check that judgment, i 

3'. When trying to decide how to score the subject* s words ^'farmers" 

or" ''the farmers'' or "most farmers,'' etc . ^ use the context in which it 
is used to decide whether to score concept No. 12, concept No. 785 
or concept No. 80-^-e.g., £f the subject writes "some farmers are not 
as prosperous as ranchers," score conce-ot No. 12 as overspecif ied . 
If the subject writes "farmers formed a procanal group," score concept 
^ Jo. 80 as incomplete. 
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Incomplete concepts at the end of a protocol 

Since ubjects were given a time limit in which to ^vrite j many subjects 
had to stop writing in mid-sentence when the time ran out. In scoring 
these sentence fragments at the end of the protocol, do not score the 
final concept in the fragment , if that final concept is incomplete. ^ 
For example 5 suppose that the final words in a protocol are: 

" Many people were angry and a civil war" 
1^1 1^2 



Score only concepts lJ+1 and 1^4-2/ but do not score the words \"a civil 
war . " 

Decisions involving subject-generated inferred or elaborative\concepts 

\ 

The sequence of scoring decisions which must be made in deciding whether* 
a string of words which correspond to one or more subject-generated 
inferred or elaborative concepts should be listed and counted a's a 
single inferred or elaborative concept are si^Yimarized in the following 
flow chart . 

1. Locate a string of words (no longer than a clause) which you 

thirik represent an elaborative or inferred concept. 



2. Are there any explicit concepts contained in the string of 
words: y^g j 

3. Are they essential: jjq Score string as a single 



I ^"^^ . elaborative concept. 

Break up the concept into Has the explicit concept 

largest possible constituent already been scored 

word groups Ygg / ^ 1^0 



V 

5* Put () around explicit concept Break up the string 

and score a single inferred into- its longest pos- 

or elaborative concept, sible constituent word 

groups and score an 
inferred or elaborative 
concept for each. 

Note that a word group can be a noun group, a verb group , a preposition 
group, an adjective group, or a clause or predicate containing these 
groups as constituents. 

Totals . ' - . 

Counts of the number of explicit concepts present, incompletely specified 
and over specif led concepts in each section should be made. Counts of inferred'^ 
and elaborative concepts present in each section should also be made 
and the results recorded. For totaling repetitions, count the number 
of^^epeats in all colxamns and record this count for each section. 
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11, Scored Input Essay: Concepts 

Circle Island is located ^ in the middle of the Atlantic Ocean . 

V ^ ^ 

, north of Ronald Island , It is ^a flat island^ with ^large grass meadows, 

7 7 
called pampas. It has ^good soil^ but ^few rivers ^ and hence ^a shortage 

of water^ , 

// 

[The main occupatlons^^on the islandi. are ^ farminp;, and ,cattle 
ranchingp Jn general^ , .the farms i of the island are .sinallu designed 
niainly to ifeed the farmer and his family,; ?^ ^ gae^Tanche^ ,less affected 
by the lack of waterj, are .large enoughi to permit jbhe ranche rs, to 
, export, imuch of tht^ir beefi. which is a black angus /variety). In fact, 
fbeef is ithe only export, ^of the islandi . Since jthe ranchers , are imuch 
more prosperous than the farmey g.. .nor^ranchers, are tfarmerst, 

^The island^ is . rim,, democrat i cally^ , .All issues, are ^decided by a 
majority vote [^of the islandersj,t , The ^actual^ governing body,, is .ja 
ten-ma n, tsenatei, called ^the Federal Assembly^ whose ^job is t o carry out 

the will of the majority^ . Since .the mo st desirable trait ,ln a 

^ ^' jrf ST ^ 

senator, is ;admini$trative ability| , the ^senate, consists of , the island' s 

tten best(provenyadministratorsr "the ,ten richest men^ . For years ^ 

,all senators, have been , ranchers, , 

/ ' • > ^/ 

(Recently;), , an /is land j scientist, , Dr , Carl Oliver , ^discovered a 

.cheap method of converting salt water into fresh water; ^ He galled 

.this method '^saline recycling ." As a result, ,some of the islan d 
^ ~^ J? ~ ' ^(^ 

farmers., wantedj to,build a c anal across the island^ so that they could 
,use water from the canal to cultivate the island' s /central reg;ion, , 
iWhichj[is called^ ^the Queensland District^ , ^Some of the farmers .^formed 

a pro-canal association^ and (^even j^persuaded a few senators to join^j 

ERIC 
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,The main opposition ^.to the Ccinal idea, came from ithe ranchersu who 
^pointed out , that if ^ new farms deprived them of p;razin^ land f, they would 
^no t be ahle to export sufficient quantities of beef to match the island H: 
imports^. Moreover, this ^deficit could not be made up. by ^ increased_ 
farming I because ^farm produce^ is not in demand in ^^ New Hampton' ' or in 
" Beatons Island ^, " which are 1:he countries with which Circle Island ^ can 
trade T!^^y also ^pointed out . that a , large canal t would ^ upset the 
i sland' s e cological . balance, because it would be ,a barrier to the 



several small species j ^whi ch ^ ^mi gra t e s ea s ona lly^ .across the island 
t hrough its central region." 

^The pro-canal association ^^ galling themselves, the Citizens Develop- 
ment Association ,^^brought the idea of constructing a 'canal to a vote.' ^^ 

^All the is lander Sj ;voted>; ^AIl the members of the pro- canal 
association, and ^all the farmers, ,voted for construction^^ and .everybody 
elseif voted against it:^ ,The majority .voted in favor of construction., 

^ " ' ' ■ 

^The senate^ however ^ , decided^ that it would be ;too ecolog ically 

(^'^ 

dangerous , to have ^a canal that was more than two feet wide and one foot 
deep.^ /After starting construction on such a canal ,|the island engineerS| 

, found no water would flow into it^^ and ^the' project had to be abandoned, . 

/// y/v ' 

, Many of the islanders , were >anp:ry, because of ,the failure of the canal 

/v/ - ' 

project >f | It appeared extremely likely that there would g."- a civil 
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CONCEPTS SCORING SHEET 

Concepts explicit 

inferred Cpreceded by a 
elaborative ("preceded by a 

bection ^ . 

Correct Inc Over Concept 



PHYSICAL DESCRIPTION 



3. y.n the middle of the CAtlantic). Ocean 
h. North of "Ronald Isl^and" 



^r-^ !-^ 5. Is flat 



6. Has (large, grass) meadow, grasslands 

8. Good soil, fertile, etc. 

9. fev rivers 

10. water shortage, lack of water 



11. MAIN OCCUPATIONS. 

12. farmers 
^'13 . ( Island ' s ) Inhabitants 
*lU . Not as prosperous as ranchers 
*15* Not ranchers 

*l6. Other occupations 

„ _ WT. Can^t buy land 

** ^ ^-*l8. Not good administrators 

** • **19.'' Farming not lucrative 

20 . Farming 

21. Ranchers 

- 22. , Much more prosperous than farmei:s 

23.' Not farmers , 

"^^2^. others (npt , ranchers and not farmers) 

25. (catt;l:§i)vrajldhing 

*26. Raise - cattle 



'''' **2T. Rich 

^*36. Poor 



EKLC 
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12. Set-Relations Scoring Instructions 

Set relations scoring, like tlie concept scoring, involves scoring a 
subject's protocol against the diagrammatic model of the original 
passage. As in the concept scoring^ set relation jscoring consists of 
categorizing a set relation in a subject's protocol in terms ,-)f trans- 
formations on a set relation in the model with^ which the set relation 
in the protocol is identified* 

Identifying a Relation 

A set relation in a subject's protocol is identifiable with a stated 
set relation in the input passage if the relation appearing in the 
protocol may be transformed into J^hat in the input passar^e by one of 
several possible transformation: 

(1) transformation of mode [relation to conditional relation and 
vice versa] 

(2) transformation of direction [for imidirectional relations or 
conditional relations] ■ 

(3) "to or from an '^identity^' [i^e/, a unidirectional relation may 
be made bi-directional or a unidirectional implication may be 
made bi-directional and vice versa] 

(h) combinations of the above 

Identification^ then, involves finding a set relation on the inap which 
corresponds to a subject's stated set relation, allowing that the 
subject may have modified the relation by one of these transformations 
Since the subject's concepts have already been identified and scored, 
location of a set relation may be accomplished comparatively easily. 
If a particular set relation in a subject's protocol involves one or 
more elaborative concepts, then it may not be identifiable with an 
e: plicit relation or one which may be inferred from the context. In 
this case, the relation is elaborative and is scored only as present 
(subject-produced) or present and necessarily false (if it contradicts 
any part of the passage)* Elaborative relations may also occur in 
cases in which both concepts are explicit or inferred.- 

Definition of Scoring Categories 

Each^et relation in a subject's protocol consists of two concepts and 
a connecting relation, A'R'B' (e.g., "Circle Island [A^] is [R'] 
flat [B']''). Scoring a subject's set relation involves entering the^ 
scores of both concepts and then scoring the relation. A subject's 
set relation A'R'B' may be explicit (if it may be identified with a 
•relation ARB which is stated explicitly in the input essay), inferred 
(if it is not identifiable with a relation which is stated directly, 
but is identifiable with a relation which is necessarily true) , or 
elaborative (if it is neither explicit nor inferred). 
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The following Scoring categories apply to explicit set relations: 

A. FOR THE COITCKPTS (A', B') : 

1.. Score ± if concept is correct (i,e.^ A' = A) 

2. Score 2_ if concept is incompletely specified (i^^e. . A' = A+) 

3. Score 3 if* concept is overspecif ied (i,e.. A' = A-) 

[Ti'IESE SCORES ARE ENTERED ON THE SCORING SHEET FROM THE 
COITCEST SCORES] . 

B. FOR THE RELATION (R Q : 

.1. Score R if relation is correct (i-e.^ R'" = R), 

2- Score M if relation is changed in mode. 

3. Score D if relation is changed in direction. 

h. Score I^ if relation is changed to or from an identity or 
bi-directional implication. 

5. ^^&6ore MD if relation is changed in "both mode and direction. 

6. - Score MI if relation is changed in both mode and to or 

from an identity or bi-directional implication 

The following scoring categories apply to inferred set relations: 

A. FOR THE CONCEPTS (A^ , B' ) : ^ . 

1. The same as for explicit concepts except that an additional 
category is possible: 

a. Score S^ if concept is a subject-produced inferred 
concept. 

B. FOR THE RELATION (R'): 

1. Score R for every inferred relation present. 
The following scoring catego'ries apply to elaborative set relations: 

A. FOR CONCEPTS (A^ B Q : 

1. The same as for concepts under II 

B. FOR RELATION (R ' ) : 

1. Score .SC if subject-produced elaborative relation is not 
necessarily Jfalse . 

2. Score SF if subj ect-produced elaborative relation is neces- 
. sarily false • ' _ 
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Entering Concept and Relation Scores 

As you proceed through a suhject's protocol^^ you will score each set 
relation as you come to it. First locate a set relation on the map 
and find the corresponding ^umber on the scoring sheet. Enter the 
previously obtained concept scores in the columns A* and (A^ is 
the first concept, is the second). If you are scoring relations and 
concepts together, you will first carry out the concept scoring, then 
enter the concept scores on the re" tioh scoring sheet. Having ntered 
the concept scores, determine the ;e of relation — explicit, inz'erred, 
or elaborative (t;,Tpe has already n listed for all nurr red relation)-- 
and then determine the appropriate score category for th relations. 
Finally, enter the code for the appropriate score categcr:' on the 
scoring sheet in the column headed oy R'. . 

Scoring Decisions 

r. Locate* the set-relation on the map which is identifiable with the 
subject* s set relation londer consideration. In making this 
^'identification^* decision, several factors are important: 

«• 

(a) If either one or both concepts are" subject-produced (scored S), 
no relation will have been previously mapped. In'this case, 
■you should list the two concepts in space provided on the 

scoring sheets. (Use the extra space under the appropriate 
section of the passage. ) If one of the two concepts is mapped, 
just write down its number. 

(b) If one or both concepts are scored S, the relation is either 
inferred or elaborative. To make this decision as to the type 
of relation, decide whether or not the set relation is neces- 
sarily true (i.e., is the subject's stated relation inferrable 
from the context). If you decide yes, then enter an "I" in the 
colimm marked "type.^* Otherwise, enter an '^E.'* This column 

' must not remain blank for any listed set relations. 

(c) Enter the appropriate concept scores for the two concepts. If 

a concept has been judged subject-produced and listed, an S \s 

should be entered. All other concepts should be scored with 

a 1 (correct), 2 (incompletely specified), or 3 (overspecif ied) . 

(d) If the subject*s set relation is explicit, decide what (if any) 
transformation is necessary to convert the subj ect ' s stated 
relation to the mapped relation. Enter the appropriate scoring 
code in the column headed R' * K^membe^r, do not read meaning into 
what a subject has written; score only what he has , said explicitly 

(e) If the subject's set relation is elaborative, decide whether or 
not his relation is. contradicted by the passage (i.e., is 
necessarily false), Tf you decide that it is necessarily false, 
score SF in the column labeled R' ; otherwise, score SC. 
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Difficult Scoring Decisions 

Two sorts of circ"umstances can - -se which complicate the abc /e scoring 
decision somewhat. These are: 

a. Implications involving ::ompoiind concepts 

b. Implications in which c :e of the concepts is replaced "by a set 
relation (nested relation) 

Rules :or scoring ea^^ch of these cases follow. 

Condit.~onal Relations ,( ''Imp li ca~: ons'*) Invo..'vi.ng Compound Concepts 

Implications may occur in "which more than two concepts are involved in 
the- set relation. Three cases can occur: 

1. the concept-set "on the left may be compound, e.g., A and B > 

2. the concept-set on the right may be compound, e-g., A > B 
and C. ' 

3* both concept-sets may be compound, e.g., A and B -> C and D 

To score implications involving compound concepts , use the following 
scoring rules: 

1. If the protocol indicates that you can break -cLown an implication 
•xn which one or both concepts are compound into separate 
implications, do so and score the separate implications 
individually* 

2, If the protocol does -not indicate that the implication can be 
broken into separate implications , then score each compound 
concept in the appropriate column (A^ or B') by: 

(a) scoring correct" if the compound concept-set contains no 
incomplete or overspecif ied concepts within the set. 

(b) scoring incompie^ely specified (A-h) if it contains 
any incomplete concepts. 

) ■ • ' 

(c) scoring overspecified (A-) if it contains any overspecif ied 
concepts (A-*s) and no incompletely specif ied "concepts 
(no A+»s), ^ 

/■ . - ■ 

When an implication involving compound concepts is scored, indicate on 

the scoring sheet vhat concepts make up each compoimd concept. 
- Nested Relations 

O Implications may occur in which one of the concepts is itself a set 
ERJC relation. Consider the follb"wing two examples taken from Circle Island. 
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Example 1. 



X Y 
rcle iland :..as few rivers , the~^e is a l:-..Gk of 



Generally; 
Example 2 : "S .. 

Generally , 

If a subject ' s 
to either of th 
rules should h': 



e Is] 



this as [X > Y] 



Z [case 1]. 



Z X 
i is a democracy , all issues are • eci.led 



ority 3te Ccf t.he islande^-s) 
vrite ,his as Z \ [X ' 



Y n 



[case 2] 



rc '^1 cc ' \ins a set relci-^.ion which :orresponc. i 
:e jes or -.heir extensions, the following seeing 
red: 



Let A = X — 
scored is ej 



and It 



A' = X' 



-> Y' 



The implication to be 



or Z'R'A^. Scoring categories for scoring 



A' (which iL itself a relation or set of relations are 

1) Sec e "1" ( correct ) -when , for example. A' = A = XRY , i.e., 
the set of relations and concepts which make up A' are all 
correctly specified by the subject. 

2) Score "2'^ ( incom: letely specified ) when, for example^ A' = 
X'RY' and either X' or Y' or both are incompletely specified, 
i.e. , the set of relations which make up A' are all correct- 
ly specified, but at least .one concept is incompletely 
specified. 

3) Score "3" for all other cases, i.e., when any one or more 
relations are transformed and/or when any one or more concepts 
are overspecif ied. This score is also to be used if any 
elaborative relations occur involving the set of concepts 

and relations in A^ which are necessarily false within the 
context of the essay. 

Note that score category (3) lumps together many possible combina- 
tions of subject transformations and elaborations. 

h) Score "S" if one (or more) of the concepts of one (or more) 
of the relations is subject-produced. 



Substitution of Identities 



Note that in scoring any relation or implication, identities may always 
be substituted. Thus, ''Queensland District" may .always be substituted 
for ^'Central Region" , etc. However, inferred identities are not to be 
treated as interchangeable. 

Additional Scoring. Rules 

1. 
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Ambiguous conditionallty . If a sub j ect' s : protocol indicates a condi- 
tional relation^ but the' concept A' or B' is ambiguous (i»e., it is 
impossible to determine exactly the concepts anc relations that are 
included in bhe A' and/or BM , then this lmplicar.ion cannot be scored. 
In other -words , do not score an implication if you cannot determine 
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the A' and/or . • 

Relations involving incomplete concepts . a: the end .of the protocol . 
Since incomplete concepts at the end of^ t:\e protocol are not to be 
scored, this means you will be unable^ to score any relations involv-^ 
ing that incomplete concept. 

Relations 5.63 and 3*62 . The B' for these relations is to be 
scored in the same vay that nested relations are scored. For 
example, suppose that subject vrites : 

"The ranchers pointed out that farms vould deprive them 

21 99 103+ 

of grazing land > resulting in a trade imbalance . 

101+ 108-h 

In the above example relation 5.11 (21^ > 99) should be 

scored R 11, relation 5-^2 (103 ^ lOU) should be scored 

R 2 1, relation 5*^6 (lOU > 108) should be -scored R 1 2 

and relation 5>62 shoiold be scored R 1 2, because concepts 
103 and 108 are incomplete . 

Repetitions . Do not talley ^^epeated relations even if the scoring 
pattern of the second occurrence of the relation is different from 
its first occurrence. Score only the first occurrence. . 

Identities . ^ . , 

(a) When scoring a relation or implication in which one of 
the con*:epts is related to another concept by an explicit 
identity relation, score the relation as present and correct 
if either of the identity concepts is present? in the subject 

' protocol. For example: Suppose the subject writes the 
following: 

" The citizens development association brought the canal 

92 " 

construction idea to a vote . 

119 

Since concepts 92 and 83 are identities (i.e., joined by 
an identity relation), you should score relation 5.6O as: 
R~l 1 . • • 

(b) If both identity concepts are present and one is correct 
{a) and the other is incomplete (A+) or overspecif led (A-), 
score the relation as : R 1 1 

(c) If both identity concepts are " present . and one is incomplete 
and the other, is overspecif ied , score the relation as: 

R 1 . 

(d) If both- identity concepts are present and both are 
overspecif ied, score the relation as: R 3 1 
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6 . Additional Inferre or Elaborative Relations expressed as I lent i tie •■ , 
These should be ma.: 'iced as follovs : 

Type Relation R ' B ' 

I 21 ^ ^ S ' R 1 S 



Scoring Relations Involving Overspecif led and Incompletely Specified 

Verbatim Concepts 

1 . Nonembedded concepts . 

(a) Incompletely specified , Wlien a nonembedded verbatim 
concept enters into a relation with another concept, 
and that verbatim concept Is present in the subject's 
protocol but is incompletely specified, the relation 
is to be scored as f ollovs : 



Example: ''The 'countries Circle Island can trade with 
are Nev Hampton and " 

Score relation 5*56 as: R 1 2 

Score verbatim concept "New 'Hampton'' as correct, 
and score "Beatons Island*' as absent (no score). 

Example: "A scientist vhose name is Dr, Oliver." 



Score relation 5-1 as: R 1 2 

Score verbatim concept "Dr. Carl Oliver" as 

incomplete . 

("b) Substitution ( overspecif icat ion ) . When a nonembedded 
verbatim concept enters into a relation with another 
concept and that verbatim concept is absent in a subject's 
protocol, but a new concept is^ substituted^ score as follows 

'Exaanple: "The central region is called Kings Region." 

Score relation 5«20 as: R l 2 

Score verbatim concept "Queensland District" 

a.s absent (no soore ) • 

List an additional elaborative concept "Kings 
" ■ Region" • 




Example: "Countries can trade with are New Hampton 
and Brighton" 

Score relation 5*56 as: R 1 2 
Score verbatim concept "New Hampton" as 
correct, score verbatim concept "Beatons Island" 
, as absent, and list an additional elaborative 
concept "Brighton".' 
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(c) Substitution and incomplete specif ication > When a non- 
eiubedded verbatim concept enters into a relation vith 
another concept and that verbatim concept is present in 
" the subject ^s protocol but is both incomplete and includes 
a substitution 5 score as follows: 

Example: ^'The procanal association is called the 
Citizens Improvement Association . " 

Score relation 5.65 as: R 1 2 
Score concept ^^Citizens Development Assoc." 
as incomplete J List an additional elaborative 
concept "(Citizens): Improvement (Assoc.)." 

Embedded Verbatim Concepts (Enclosed in parentheses ) . 

(a) Substitution (overspecif ication) . When a concept has an 

embedded verbatim concept which is enclosed in parentheses » 
then that concept is to be scored independently of the 
verbatim concept. Hovever , when a substitution is made 
for the embedded concept, that substitution must be 
listed as an additional elaborative concept. 

Example: "Circle Island is in the middle of the Pacific 
Ocean." 

Score relation 1.1 as: R 1 1 

Score verbatim concept "Atlantic " as absent and 
List an additional elaborative concept "Pacific.'" 

Example: "Tlie senate has 12 members." 

Score relation li.lO as: R 1 1 

Score verbatim concept "ten" as absent and. 

List an additional elaborative concept "12". 

Embedded Verbatim Concepts (Enclosed in quotations ) 

(a) When a concept has an embeddejd verbatim concept in it 
and the embedded concept is "enclosed in quotations , the 
subject must indicate that "something is there", but 
it does not matter what the words are for scoring the 
concept in which the verbatim item is embedded. 

Example: "Circle Island is north of Roanoke" 

Score relation 1*2 as; R 1 1 ■ 

Score concept number h as correct , score verbatim 
• , concept "Ronald Island" as absent, and 

List "Roanoke" as an additional elaborative concept 

(b) Substituti6n and incomplete specification - When an 

embedded verbatim concept which is^enclosed ip quotations 
enters into a relation with an oth^?^ concept and that 
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yerbatiin concept is present in the subject's protocol 
but is both substituted and incomplete, score as f ollovs : 

Example: "Farm produce is not wanted in North He^mpton 
and Brighton", 

Score Relation 5,53 as: ,R 1 1 
Score concept 110 as correct, score verbatim 
concept "New Hampton'' as/ incomplete , score 
verbatim concept ''Beaton^ s Island" as absent-, arid 
list two additional elaborative conce-ots 
"brighton" and "North (Hampton)", 

Scoring R elations I nvolving an Overspecif ied and Incompletely Specified 
Concept , 

V^en a concept is both overspeci f ied and incompletely specified, 
score as follows : 

Example: "A large canal would be a barrier to flocks of 
seasonally migrating birds and would therefore 
upset the ecological balance • 

* * 

Score relation 5-38 as: R 1 2 

Score concept 101 as incomple'te, concepts 102 

and 113 as correct, and 

List an additional elaborative concept "flocks 
of birds", to be scored: Sf 2 S 
List an additional elaborative relation 
, between 101 and "flocks of birds", to be scored: 
Sf 2 S 

List an additional elaborative relation between 
"flocks of birds" and 113, to be scored: Sc S 1 
List an additional elaborative implication between 

(101 > "flocks of birds") and 102, to be 

scored: Sf S 1 

Trivial Transformations 

A transformation should not be scored unless it changes the sense of 
the. relation between the two concepts involved such that the relation 
is no longer "true" in the sense of what has been stated in the passage. 
For exarapae^ ^a subject may state that "farmers caused a procanal group 
to be fomied" rather than "formed a procanal group" or they might 
■'M.-j.-r-^ "the ten best administrators make up the senate". These trans- 
r^riiations of mode and direction are trivial in that they do not change 
the "sense" as represented in the mapped relations and therefore 
should be scored as "R" rather than as transformations. Using this as 
a guide, transformations should be relatively rare. ^ . - 

Decisions involving implied causality . 

Certain English constructions, particularly eliptical constructions and 
constructions involving participles and infinitives answer the question 
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''vhy" and imply some cause-effect relation. 
Examples :• 

1- ^akinp: advantage of their pover . the senators limited 
the size oi the canal. 

2. Beinfi rnor,e_ prosperous , no ranchers are farmers. 

3. The farmers formed a procanal group to lobby for a canal > 

In the above examples, only those instances in vhich the cause-effect 
relation is inescapable are to be scored as conditional relations. " 
Therefore, only example 2 above vould be scored as a conditional 
re ' at ion between *'being more prosperous'^ and "no ranchers are farmers, e.g. 

ranchers ) being more prosperous \ ranchers ^ not farmers 

Example 1 should be scored: 

senators ^ taking advantage of their power 

senators ^ limited the size of the canal 

Example 3 should be scored: 

farmers ^ formed a procanal group ^ to lobby for a canal 

Procedures for directly marking protocols : The following marking 
procedures have been successful in scoring -directly on the computer 
listed protocols : 

1. Note if a concept is to be scored incomplete or over- 
specified, e.g. 98+ or 98-. 

2. Note the section number for additional inferred and 
additional elaborative concepts, e.g., **III or ^VA. 
This should be done with Roman Numerals. 

3. Be sure to write in the concept numbers in the order in 
which they are to be sequenced, e.g., 

Carl Oliver foiond a cheap wa y to convert salt water 

^ n ih j L 

into fresh vater , called Saline Recycling . He built a 
J ~ " T 

desalting plant . ' 
J **VA 
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SET RELATIONS SCORING SHEET 



ITEM TYPES 

1. Nothing precedes explicit items. 

2. Aji "l" precedes inferred items. 

■ 3. Aji "E" precedes elaborative items. 

scop£ categories' 

1. .. A', B': 1(A), 2(A+), 3(A-), or Wank C0). 

2. R': R, M, D, I, MD, MI, SF, SC (elaborative) 



SEMAJ-JTIC RELATIONS CONDITIONAL HEUTlONS 

Type Relation R' A' B' Type Relation R' 

1.1 2 ^3 _ _ _ 1.6 (2^9)=^ (2-10) _ 

1.2 2 — ) ^ _ „ _ 

1.3 2 — ^5 _ _ • 
l.h 2—^6 - ■ 



I 2.3 12—411+ _ „ S 
I 2.h 12 — )15 _ S 
I. 2.6 13 — >11 S 

2.7 11 — )25 

2.8 21 — )22 

I 2.10 21 — ) 26 _ _ S 

2.12 21 — >23 
I. 2.13 13 — )16 _ S S 
I 2.II4 13 — ) 21 _ S _ 
I 2.15 13 — ^ 12 „ S _ 
I 2.16 13—^ 2h ■ S S 



1.5 6f-^7 „ „ _ 

1.6 2 — ) 8 _ _ _ 

1.7 2 — )9 _ _ 

2.1 11 — ) 20 _ _ _ I 2.5 (21->22)=:^ 

E 2.2 12 — )127 2.9 

- - . - ^ (21-^ 77)=^ 



(21-^23). 
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lU . Sucnnar^^ of Possible 'Score Patterns 

Concepts 

A summary of all possible subject transformations on any explicit or 
inferred relation (vhich is either stated explicitly or is derivable 
from the input essay) consisting of tvo concepts and a connecting 
relation or implication is given in Figure 3.9. If A'R'B' represent 
any set relation stated in a subj ect ' s protocol , and ARB represents 
any set relation stated explicitly in the input essay (and located 
on the map), then any- concept A^ found in a subject's protocol may 
be a correct representation of A, an incompletely specified representa- 
tion of A, or an overspecif ied representation of A. If the subject's 
concept - A' . does not . correspond to any explicit mapped concept, it is 
considered to be subject-produced. If a subject-produced concept A' 
enters into any relations (with explicit concepts) vhich are nece sarily 
true, the concept is considered to be i'-'.ferred; othei^se it is considered 
to be elaborative. Thus, on the concept scoring sheets, .explicit 
concepts are scored as correct (A), incomplete (A+) , or overspecif ied 
(A-);". Inferred or elaborative concepts (listed ones are preceded by 
* or respectively) are scored only as present (by placing a check 

in the A column)-. 

Set Relations 

A set relation R' in a subject's protocol corresponds to an explicit 
set, relation R if it may be transformed into the explici-t relation R 
appearing in the input essay ( and represented in the map) by applying 
one of the transformations identified earlier. Every explicit set 
relation has been diagrammed and appears as a number (referring to the 
appropriate number on the map) on the scoring sheet. In the column 
of the score sheet labeled R' the scorer lists a code indicating 
precisely what transformation was required to match the explicit 
relation R to ^the subject's stated relation R' . Of course, if the 
explicit relation does not appear in a subject ^s protocol, no score is 
entered. For explicit relations, scores for concepts related by R* may 
be A (correct), A-H (incompletely specified), or A- (overspecif ied) . 
Thus, there are 3 x 3 x 6 = 5^ possible score patterns, 

A set relation R' in a subject ^s protocol correspt)nds to an Inferred 
set relation R if.it is necessarily true . Some if>f;^^^d relations and 
implications have been diagrammed and nixnibered on the scoring sheets; 
others have not and must be listed under "Additional Relations'* or 
"Additional Implications". Possible scores for an inferred relation 
are either R or a blank • Possible scores for the concepts linked by 
the relation or implication R' are A, A+ , A--^ or S Ca subject -produced 
inferred concept hot corresponding to any mapped concept). Thus, there 
are U x U = l6 possible score patterns. 

Elaborative set relations are relations or implications which appear 
in a subject's protocol and which are not explicit or inferred Ci.e., 
they are not transformable into any explicit or inferred relation or 
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inplication). Hoot, an elatorative relation may be false if it 
contradicts any relation appearing in the passage or anj relation 
inferrable from the passage (i.e., if it contradicts the "sense" of the 
passage!, ^ fc, an elaborative relation may be scored S (subject- 
produced but not necessarily false) or SF (subject-produced and 
necessarily false]. Elaborative relations lay involve concepts vhich 
are scorable as A, or S. Thus, there are 1| x h 2 = 32 
possible score patterns for elaborative relations. 
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Footnotes 



Chapter 2 v , . 

1. Note that these activities are nov: specifically identified by 
Rothkopf . 

2. See the previous remarks concerning structured deletions and 
semantically incomplete texts (Chapter 1, section 1-3, page 8). 

Chapter 3 

1. See Chapter 9 for definitions of specific semantic relations 
including the "case" relations agent, instrument, object, etc. 

2. See Chapter 9 for a discussion of the semantic relation "theme/' 

3. , Negation is represented by negating a concept-set. Qualifying 

medals are not represented in the present model. The semantic 
model presented in Chapter 9 defines a set of operators on the 
truth value of a proposition which operate on the truth value 
of a relation defining a proposition. 

4. See* footnote 3. 

5. Fdr a complete account of the scoring procedures discussed here, 
see the manual for scorers which is reproduced in Appendix A, 

6. As will be seen in Chapter 9, this may be due in part to the 
fact that it is by no means clear what constitutes a valid 
inference for certain propositions devised to represent natural 
language discourse. 

Chapter 4 

1. According to the model developed in Chapter 2, the semantic 
structure for this sentence is (simplifying somewhat): 



SOURCE 


[car 


LOG 


road] 


, , AGT OBJ 
John move 


car 


CAT 


new 


FAC 


[car 


LOC 


garage] 
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Chapter 4 (contM,) 

2, Verification of class correspondence might be described 

alternatively in corapar^ison to verification of identity as a 
process involving the discrimination of concept classes. 
Types of verification not involving an identity match might 
be called weak verification but the general term adopted here 
is verification of a derivational match since if appropriate 
operations are applied to generated elements, a match would 
result . I 

Chapter 5 

!• It is naturally not possible to test this hypothesis ex^tly. 

2, Note that if the experimental groups differ in total amount of 
semantic information acquired, these hypotheses could be 
interpreted in terms of the relative frequencies of the appropriate 
response classes. 

3. See footnote 2. , ; 
Chapter 9 

1. See/ e.g.. Leech's (1969, 31-34) discussion ofy"rules of expression. 
2* See Simmons (1971, 24-38) for a discussion of lexical structures/ 

3. See Leech (1969, 71-79) for a discussion of rules for synonymy. 

4. CrotheKs (1970) presents a discussion of dominance^ 

5. This interpretation of differentiation has been adopted by Dawes 
(1966), Frase (1969), and Frederiksen (1971 and the present report). 

6. See Crothers (1970) for a discussion of the possible importance 
of superordinate structures. \. 

7.. See Leeches (1969) discussion of downgrading and rank shifting. 

8. Fillmore uses this example to demonstrate that an intervening 
^'instrument" in a causal chain involving more than three objects, 

^ may not be expressed using the ^.preposition "with" which is dominated 
by the case category instrumentality. 

9. The latter example was offered by Fillmore, 1971, p. 41^ 

10. A series of papers by Zadeh (1964, 1968, 1971a, b) are concerned 

with the problem of representing imprecise statements in set notation 
as "fuzzy sets" and with exploring properties and applications of 
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, Chapter 9 (cont'd.) 

this definition, A fuzzy set is defined in terms of a "membership 
function": assigning to each object x in a space of objects X a • 
real number f(x) (o < f(x) < 1) which represents the degree of . 
membership of, the object in the fuzzy set. 

11. See leech's (1965, pp. 232-238) discussion of the "hypothetical 
fonnator," ■ 

Chapter 10 , 

1, If a model is to be fit to data based on a single instance of a .. 
graph-structure (e.g. the above example), a model is required ^;hich 
relates a linear structural model to a binary response vector v. 

2. Jiireskog, K. G. and van Thillo,.M. LISREL- A general computer 
program for estimating linear structural relationships. Research 

• .Bulletin, Princeton, NJ.: Educational Testing Service, 1973, 



